trl/source at c8a5add88af1e2d3d6b9cc962003993e251946d1 - trl

_toctree.yml

🗑️ Remove deprecated AlignPropTrainer, DDPOTrainer and IterativeSFTTrainer (#4068 )

2025-09-15 09:56:41 -06:00

bco_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824 )

2025-08-16 23:26:02 -07:00

best_of_n.md

Add autodoc for BestOfNSampler and improve docstrings (#4034 )

2025-09-09 20:28:02 +02:00

callbacks.md

🧶 feat: Add WeaveCallback for W&B Weave integration (#4089 )

2025-09-17 18:10:45 -06:00

clis.md

🔥 [Refactor] RLOOTrainer (#3801 )

2025-08-29 09:27:28 -06:00

community_tutorials.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

cpo_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824 )

2025-08-16 23:26:02 -07:00

customization.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

data_utils.md

♻️ Reuse multimodal message preparation from SFTTrainer in GRPOTrainer (#3919 )

2025-08-20 10:04:54 -07:00

dataset_formats.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

deepspeed_integration.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

detoxifying_a_lm.md

📏 torch_dype to dtype everywhere (#4000 )

2025-09-03 15:45:37 -06:00

distributing_training.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

dpo_trainer.md

Add missing FDivergenceType docstring (#4165 )

2025-09-29 20:03:33 +02:00

example_overview.md

🗑️ Remove deprecated AlignPropTrainer, DDPOTrainer and IterativeSFTTrainer (#4068 )

2025-09-15 09:56:41 -06:00

experimental.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

gkd_trainer.md

Improve trainer doc (#3818 )

2025-08-01 11:14:16 +02:00

grpo_trainer.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

how_to_train.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

index.md

👁️ VLM blog (#3899 )

2025-08-14 17:09:16 -07:00

installation.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

jobs_training.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

judges.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

kernels_hub.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

kto_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824 )

2025-08-16 23:26:02 -07:00

liger_kernel_integration.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

logging.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

model_utils.md

💬 Fix setup_chat_format and add clone_chat_template (#3404 )

2025-06-15 15:59:42 +02:00

models.md

👋 Drop MDX (#2611 )

2025-01-23 13:38:15 +01:00

multi_adapter_rl.md

👋 Drop MDX (#2611 )

2025-01-23 13:38:15 +01:00

nash_md_trainer.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

online_dpo_trainer.md

Fixed some <Tip> rendering issues (#4143 )

2025-09-25 14:47:46 -06:00

orpo_trainer.md

🗿 [CPO] Add AlphaPO method via CPOTrainer (#3824 )

2025-08-16 23:26:02 -07:00

others.md

🪪 Adds a more fine-grained profiling context (#2975 )

2025-02-27 21:58:39 +01:00

paper_index.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

peft_integration.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

ppo_trainer.md

Improve trainer doc (#3818 )

2025-08-01 11:14:16 +02:00

prm_trainer.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

quickstart.md

Fix typo in GRPO quickstart (#4020 )

2025-09-06 10:31:09 +02:00

reducing_memory_usage.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

reward_trainer.md

Improve trainer doc (#3818 )

2025-08-01 11:14:16 +02:00

rewards.md

🔥 [Refactor] RLOOTrainer (#3801 )

2025-08-29 09:27:28 -06:00

rloo_trainer.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

script_utils.md

🎚️ Add dataset mixer (#3791 )

2025-08-11 20:14:50 -07:00

sentiment_tuning.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

sft_trainer.md

Fix PEFT interlinks in docstrings (#4178 )

2025-09-30 18:32:23 +02:00

speeding_up_training.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

trackio_integration.md

🎯 Add Trackio integration documentation and update TOC (#3971 )

2025-09-02 13:06:06 -06:00

unsloth_integration.md

🦥 Unsloth Docs update (#3955 )

2025-08-26 20:17:21 -07:00

use_model.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

using_llama_models.md

Fixed some typos and added small details about trackio to docs (#3965 )

2025-08-27 17:57:19 +02:00

vllm_integration.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00

xpo_trainer.md

💡 Replace <Tip> with new markdown syntax (#4161 )

2025-09-29 10:48:00 -06:00