frozenleaves/peft
1
0
Fork 0
mirror of https://github.com/huggingface/peft.git synced 2025-10-20 15:33:48 +08:00
Code Issues Packages Projects Releases Wiki Activity

FIX Typo in PiSSA finetune README (#2812)

Browse Source
This commit is contained in:
Zhizhou Sha
2025-10-06 04:54:53 -05:00
committed by GitHub
parent 24aebeec21
commit f00d94a170
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/pissa_finetuning/README.md
View File

@ -6,7 +6,8 @@ PiSSA represents a matrix $W\in\mathbb{R}^{m\times n}$ within the model by the p
```python
import torch
from peft import LoraConfig, get_peft_model
from transformers import AutoTokenizer, AutoModelForCausalLMfrom trl import SFTConfig, SFTTrainer
from transformers import AutoTokenizer, AutoModelForCausalLM
from trl import SFTConfig, SFTTrainer
from datasets import load_dataset
model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-hf", torch_dtype=torch.bfloat16, device_map="auto")