frozenleaves/trl
1
0
Fork 0
mirror of https://github.com/huggingface/trl.git synced 2025-10-20 18:43:52 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
9df19e8a7564fc5713a6a29b0fe377e16ca1623a
trl/examples/research_projects/layer_skip
History
Quentin Gallouédec 9df19e8a75 📜 Fix license and copyrights (#3264)
2025-04-08 15:22:58 -07:00
..
scripts
📜 Fix license and copyrights (#3264)
2025-04-08 15:22:58 -07:00
README.md
🐇 [Research] Layer Skip SFT (#3111)
2025-03-24 11:02:00 -07:00

README.md

LayerSkip Training Recipe

Implements the training recipe as described in the LayerSkip paper.

Run training

cd scripts
python layer_skip_sft.py

Run benchmark

cd scripts
python benchmark_layer_skip.py