mirror of https://github.com/huggingface/accelerate.git synced 2025-10-20 18:13:46 +08:00

Files

Sayak Paul d02e51cc21 Update big_modeling.md for layerwise casting (#3548 )

* Update big_modeling.md for layerwise casting

* doc fix

2025-05-06 09:50:53 +02:00

2.3 KiB

Raw Permalink Blame History

Working with large models

Dispatch and offload

init_empty_weights

autodoc big_modeling.init_empty_weights

cpu_offload

autodoc big_modeling.cpu_offload

cpu_offload_with_hook

autodoc big_modeling.cpu_offload_with_hook

disk_offload

autodoc big_modeling.disk_offload

dispatch_model

autodoc big_modeling.dispatch_model

load_checkpoint_and_dispatch

autodoc big_modeling.load_checkpoint_and_dispatch

load_checkpoint_in_model

autodoc big_modeling.load_checkpoint_in_model

infer_auto_device_map

autodoc utils.infer_auto_device_map

Hooks

ModelHook

autodoc hooks.ModelHook

AlignDevicesHook

autodoc hooks.AlignDevicesHook

SequentialHook

autodoc hooks.SequentialHook

LayerwiseCastingHook

autodoc hooks.LayerwiseCastingHook

Adding Hooks

add_hook_to_module

autodoc hooks.add_hook_to_module

attach_execution_device_hook

autodoc hooks.attach_execution_device_hook

attach_align_device_hook

autodoc hooks.attach_align_device_hook

attach_align_device_hook_on_blocks

autodoc hooks.attach_align_device_hook_on_blocks

attach_layerwise_casting_hooks

autodoc big_modeling.attach_layerwise_casting_hooks

Removing Hooks

remove_hook_from_module

autodoc hooks.remove_hook_from_module

remove_hook_from_submodules

autodoc hooks.remove_hook_from_submodules

Utilities

has_offloaded_params

autodoc utils.has_offloaded_params

align_module_device

autodoc utils.align_module_device

2.3 KiB Raw Permalink Blame History