Quentin Gallouédec 9603b41d7e 😷 Refactor GRPO/RLOO to isolate _generate (#4114)

2025-09-25 20:48:52 -06:00

..

_toctree.yml

🗑️ Remove deprecated AlignPropTrainer, DDPOTrainer and IterativeSFTTrainer (#4068)

2025-09-15 09:56:41 -06:00

bco_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824)

2025-08-16 23:26:02 -07:00

best_of_n.md

Add autodoc for BestOfNSampler and improve docstrings (#4034)

2025-09-09 20:28:02 +02:00

callbacks.md

🧶 feat: Add WeaveCallback for W&B Weave integration (#4089)

2025-09-17 18:10:45 -06:00

clis.md

🔥 [Refactor] RLOOTrainer (#3801)

2025-08-29 09:27:28 -06:00

community_tutorials.md

Community Tutorials design adaptation for videos (#4095)

2025-09-16 16:28:22 +02:00

cpo_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824)

2025-08-16 23:26:02 -07:00

customization.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

data_utils.md

♻️ Reuse multimodal message preparation from SFTTrainer in GRPOTrainer (#3919)

2025-08-20 10:04:54 -07:00

dataset_formats.md

📽 Multi image support for GRPO/RLOO (#4113)

2025-09-22 18:17:42 -06:00

deepspeed_integration.md

🚀 DeepSpeed integration documentation (#2993)

2025-03-03 14:51:45 +01:00

detoxifying_a_lm.md

📏 torch_dype to dtype everywhere (#4000)

2025-09-03 15:45:37 -06:00

distributing_training.md

🏞️ Context Parallelism benchmark guide (#4075)

2025-09-16 08:46:12 -06:00

dpo_trainer.md

📏 torch_dype to dtype everywhere (#4000)

2025-09-03 15:45:37 -06:00

example_overview.md

🗑️ Remove deprecated AlignPropTrainer, DDPOTrainer and IterativeSFTTrainer (#4068)

2025-09-15 09:56:41 -06:00

experimental.md

😷 Refactor GRPO/RLOO to isolate _generate (#4114)

2025-09-25 20:48:52 -06:00

gkd_trainer.md

Improve trainer doc (#3818)

2025-08-01 11:14:16 +02:00

grpo_trainer.md

Fixed some <Tip> rendering issues (#4143)

2025-09-25 14:47:46 -06:00

how_to_train.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

index.md

👁️ VLM blog (#3899)

2025-08-14 17:09:16 -07:00

installation.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

jobs_training.md

Reviewed HF jobs updated docs (#4088)

2025-09-15 08:41:08 -06:00

judges.md

👋 Drop MDX (#2611)

2025-01-23 13:38:15 +01:00

kernels_hub.md

🏞️ Context Parallelism benchmark guide (#4075)

2025-09-16 08:46:12 -06:00

kto_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824)

2025-08-16 23:26:02 -07:00

liger_kernel_integration.md

🌺 OpenAI GPT OSS & Harmony support (#3848)

2025-08-05 09:44:59 -07:00

logging.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

model_utils.md

💬 Fix setup_chat_format and add clone_chat_template (#3404)

2025-06-15 15:59:42 +02:00

models.md

👋 Drop MDX (#2611)

2025-01-23 13:38:15 +01:00

multi_adapter_rl.md

👋 Drop MDX (#2611)

2025-01-23 13:38:15 +01:00

nash_md_trainer.md

⚖️ Add vLLM server mode and VLM support to OnlineDPOTrainer (#3783)

2025-09-05 16:58:49 -06:00

online_dpo_trainer.md

Fixed some <Tip> rendering issues (#4143)

2025-09-25 14:47:46 -06:00

orpo_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824)

2025-08-16 23:26:02 -07:00

others.md

🪪 Adds a more fine-grained profiling context (#2975)

2025-02-27 21:58:39 +01:00

paper_index.md

🪙 [Experimental] Support GSPO-token (#3820)

2025-09-24 09:57:18 -06:00

peft_integration.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

ppo_trainer.md

Improve trainer doc (#3818)

2025-08-01 11:14:16 +02:00

prm_trainer.md

Improve trainer doc (#3818)

2025-08-01 11:14:16 +02:00

quickstart.md

Fix typo in GRPO quickstart (#4020)

2025-09-06 10:31:09 +02:00

reducing_memory_usage.md

docs: correct option name to enable vllm sleep mode (#4102)

2025-09-22 13:04:00 +02:00

reward_trainer.md

Improve trainer doc (#3818)

2025-08-01 11:14:16 +02:00

rewards.md

🔥 [Refactor] RLOOTrainer (#3801)

2025-08-29 09:27:28 -06:00

rloo_trainer.md

😴 Add vllm_enable_sleep_mode to RLOO Trainer (#4107)

2025-09-22 19:41:29 -06:00

script_utils.md

🎚️ Add dataset mixer (#3791)

2025-08-11 20:14:50 -07:00

sentiment_tuning.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

sft_trainer.md

Fixed some <Tip> rendering issues (#4143)

2025-09-25 14:47:46 -06:00

speeding_up_training.md

📌 Pin vLLM version (#4122)

2025-09-23 08:02:30 -06:00

trackio_integration.md

🎯 Add Trackio integration documentation and update TOC (#3971)

2025-09-02 13:06:06 -06:00

unsloth_integration.md

🦥 Unsloth Docs update (#3955)

2025-08-26 20:17:21 -07:00

use_model.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

using_llama_models.md

Fixed some typos and added small details about trackio to docs (#3965)

2025-08-27 17:57:19 +02:00

vllm_integration.md

📌 Pin vLLM version (#4122)

2025-09-23 08:02:30 -06:00

xpo_trainer.md

⚖️ Add vLLM server mode and VLM support to OnlineDPOTrainer (#3783)

2025-09-05 16:58:49 -06:00