mirror of
https://github.com/huggingface/peft.git
synced 2025-10-20 15:33:48 +08:00
f1b83646a6
Deduplicate a lot of redundant code from PEFT method's model.py: merge_and_unload unload delete_adapter set_adapter enable_adapter_layers disable_adapter_layers _replace_module _unload_and_optionally_merge _mark_only_adapters_as_trainable _check_new_adapter_config _check_target_module_exists _prepare_adapter_config __getattr__ get_peft_config_as_dict (fully deleted) Related changes: A new module, functional.py, is introduced, which contains functions (just reimported from elsewhere) that can be useful for libraries that want to integrate PEFT. I would suggest that we should treat them as public API and thus guarantee backwards compatibility. I also deduplicated almost identical TRANSFORMERS_MODULES_TO_XXX_TARGET_MODULES_MAPPING constants by copying them from LoRA and only overriding a few values that differ. Moreover, some PEFT methods didn't have their own TRANSFORMERS_MODULES_TO_XXX_TARGET_MODULES_MAPPING but used the one from LoRA instead. They now each have their own constant, which is a copy from the one from LoRA.
150 lines
4.1 KiB
YAML
150 lines
4.1 KiB
YAML
- title: Get started
|
|
sections:
|
|
- local: index
|
|
title: 🤗 PEFT
|
|
- local: quicktour
|
|
title: Quicktour
|
|
- local: install
|
|
title: Installation
|
|
|
|
- title: Tutorial
|
|
sections:
|
|
- local: tutorial/peft_model_config
|
|
title: Configurations and models
|
|
- local: tutorial/peft_integrations
|
|
title: Integrations
|
|
|
|
- title: PEFT method guides
|
|
sections:
|
|
- local: task_guides/prompt_based_methods
|
|
title: Prompt-based methods
|
|
- local: task_guides/lora_based_methods
|
|
title: LoRA methods
|
|
- local: task_guides/ia3
|
|
title: IA3
|
|
|
|
- title: Developer guides
|
|
sections:
|
|
- local: developer_guides/model_merging
|
|
title: Model merging
|
|
- local: developer_guides/quantization
|
|
title: Quantization
|
|
- local: developer_guides/lora
|
|
title: LoRA
|
|
- local: developer_guides/custom_models
|
|
title: Custom models
|
|
- local: developer_guides/low_level_api
|
|
title: Adapter injection
|
|
- local: developer_guides/mixed_models
|
|
title: Mixed adapter types
|
|
- local: developer_guides/torch_compile
|
|
title: torch.compile
|
|
- local: developer_guides/contributing
|
|
title: Contribute to PEFT
|
|
- local: developer_guides/troubleshooting
|
|
title: Troubleshooting
|
|
- local: developer_guides/checkpoint
|
|
title: PEFT checkpoint format
|
|
|
|
- title: 🤗 Accelerate integrations
|
|
sections:
|
|
- local: accelerate/deepspeed
|
|
title: DeepSpeed
|
|
- local: accelerate/fsdp
|
|
title: Fully Sharded Data Parallel
|
|
|
|
- title: Conceptual guides
|
|
sections:
|
|
- local: conceptual_guides/adapter
|
|
title: Adapters
|
|
- local: conceptual_guides/prompting
|
|
title: Soft prompts
|
|
- local: conceptual_guides/ia3
|
|
title: IA3
|
|
- local: conceptual_guides/oft
|
|
title: OFT/BOFT
|
|
|
|
- sections:
|
|
- sections:
|
|
- local: package_reference/auto_class
|
|
title: AutoPeftModel
|
|
- local: package_reference/peft_model
|
|
title: PEFT model
|
|
- local: package_reference/peft_types
|
|
title: PEFT types
|
|
- local: package_reference/config
|
|
title: Configuration
|
|
- local: package_reference/tuners
|
|
title: Tuner
|
|
title: Main classes
|
|
- sections:
|
|
- local: package_reference/adalora
|
|
title: AdaLoRA
|
|
- local: package_reference/ia3
|
|
title: IA3
|
|
- local: package_reference/llama_adapter
|
|
title: Llama-Adapter
|
|
- local: package_reference/loha
|
|
title: LoHa
|
|
- local: package_reference/lokr
|
|
title: LoKr
|
|
- local: package_reference/lora
|
|
title: LoRA
|
|
- local: package_reference/xlora
|
|
title: X-LoRA
|
|
- local: package_reference/adapter_utils
|
|
title: LyCORIS
|
|
- local: package_reference/multitask_prompt_tuning
|
|
title: Multitask Prompt Tuning
|
|
- local: package_reference/oft
|
|
title: OFT
|
|
- local: package_reference/boft
|
|
title: BOFT
|
|
- local: package_reference/poly
|
|
title: Polytropon
|
|
- local: package_reference/p_tuning
|
|
title: P-tuning
|
|
- local: package_reference/prefix_tuning
|
|
title: Prefix tuning
|
|
- local: package_reference/prompt_tuning
|
|
title: Prompt tuning
|
|
- local: package_reference/layernorm_tuning
|
|
title: Layernorm tuning
|
|
- local: package_reference/vera
|
|
title: VeRA
|
|
- local: package_reference/fourierft
|
|
title: FourierFT
|
|
- local: package_reference/vblora
|
|
title: VB-LoRA
|
|
- local: package_reference/hra
|
|
title: HRA
|
|
- local: package_reference/cpt
|
|
title: CPT
|
|
- local: package_reference/bone
|
|
title: Bone
|
|
- local: package_reference/trainable_tokens
|
|
title: Trainable Tokens
|
|
- local: package_reference/randlora
|
|
title: RandLora
|
|
- local: package_reference/shira
|
|
title: SHiRA
|
|
- local: package_reference/c3a
|
|
title: C3A
|
|
- local: package_reference/miss
|
|
title: MiSS
|
|
- local: package_reference/road
|
|
title: RoAd
|
|
|
|
title: Adapters
|
|
- sections:
|
|
- local: package_reference/merge_utils
|
|
title: Model merge
|
|
- local: package_reference/helpers
|
|
title: Helpers
|
|
- local: package_reference/hotswap
|
|
title: Hotswapping adapters
|
|
- local: package_reference/functional
|
|
title: Functions for PEFT integration
|
|
title: Utilities
|
|
title: API reference
|