NeMo Gym Tutorials

Hands-on tutorials to build and customize your training environments.

Tip

New to NeMo Gym? Begin with the Get Started section for a guided tutorial from installation through your first verified agent. Return here afterward to learn about advanced topics like additional rollout collection methods and training data generation. You can find the project repository on GitHub.

---

Building Custom Components

Create custom resource servers and implement tool-based agent interactions.

Creating a Resource Server

Implement or integrate existing tools and define task verification logic.

beginner 30 min custom-environments tools

Creating a Resource Server

---

Rollout Collection and Training Data

Implement rollout generation and training data preparation for RL, SFT, and DPO.

Offline Training with Rollouts

Transform rollouts into training data for supervised fine-tuning (SFT) and direct preference optimization (DPO).

sft dpo

Offline Training with Rollouts (SFT/DPO) - Experimental

---

RL Training

GRPO with NeMo RL

Learn how to set up NeMo Gym and NeMo RL training environments, run tests, prepare data, and launch single-node and multi-node training runs.

training rl grpo

RL Training with NeMo RL using GRPO