mirror of
https://github.com/pytorch/pytorch.git
synced 2025-10-21 05:34:18 +08:00
Fixes #155021 Fixes #155158 Pull Request resolved: https://github.com/pytorch/pytorch/pull/155369 Approved by: https://github.com/svekars, https://github.com/malfet
1.3 KiB
1.3 KiB
FullyShardedDataParallel
.. automodule:: torch.distributed.fsdp
.. autoclass:: torch.distributed.fsdp.FullyShardedDataParallel
:members:
.. autoclass:: torch.distributed.fsdp.BackwardPrefetch
:members:
.. autoclass:: torch.distributed.fsdp.ShardingStrategy
:members:
.. autoclass:: torch.distributed.fsdp.MixedPrecision
:members:
.. autoclass:: torch.distributed.fsdp.CPUOffload
:members:
.. autoclass:: torch.distributed.fsdp.StateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.FullStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.ShardedStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.LocalStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.OptimStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.FullOptimStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.ShardedOptimStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.LocalOptimStateDictConfig
:members:
.. autoclass:: torch.distributed.fsdp.StateDictSettings
:members: