mirror of
https://github.com/huggingface/peft.git
synced 2025-10-20 23:43:47 +08:00
273acf059e
Add LoRA+: Efficient Low Rank Adaptation of Large Models https://arxiv.org/abs/2402.12354 Call create_loraplus_optimizer to initialize an optimizer with optimizer parameters that are especially effective for LoRA training. Builds upon this code base: https://github.com/nikhil-ghosh-berkeley/loraplus --------- Co-authored-by: moghadas76 <s.m.moghadas2012@gmail.com> Co-authored-by: Chris Hua <stillmatic@users.noreply.github.com>