Skip to content

docs(cookbooks): formalize the RL training guide - #582

Open
ChinmayK0607 wants to merge 2 commits into
mainfrom
chinmay/rl-training-readme-cleanup
Open

docs(cookbooks): formalize the RL training guide#582
ChinmayK0607 wants to merge 2 commits into
mainfrom
chinmay/rl-training-readme-cleanup

Conversation

@ChinmayK0607

Copy link
Copy Markdown
Contributor

What changed

  • Reorganized the RL training cookbook around setup, runnable commands, training flow, trajectory transport, and loss behavior.
  • Replaced conversational and fragment-heavy prose with concise technical explanations.
  • Added reference tables for runtime trajectory handling and built-in losses.
  • Clarified the custom-loss execution path, supported inputs, and value-head limitation without changing the examples or APIs.

Why

The existing README was dense and difficult to scan. It mixed setup, architecture, and implementation details, which made the cookbook harder to follow for readers using it as a training guide.

Impact

The cookbook now provides a clearer path from setup to a first run, while preserving the details needed to understand remote and local trajectories, built-in objectives, and custom policy-gradient losses.

Validation

  • Documentation-only change; no runtime behavior changed.
  • Reviewed the rendered README in the local cookbook preview.
  • Checked the final diff for whitespace errors and removed conversational filler and em dashes.

Made with Cursor

ChinmayK0607 and others added 2 commits August 13, 2026 22:27
Turn the fragment-heavy README into flowing human-facing prose: full
sentences, motivation before mechanics, and fewer bold/dash patterns.
No content changes.

Co-authored-by: Cursor <cursoragent@cursor.com>
Restructure the cookbook around setup, execution, data flow, and loss behavior so it reads as a concise technical guide rather than conversational prose.

Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant