Rodrigo Kumpera c17bdb3247 [C10D] Add functional collective reduce_scatter_into_tensor_coalesced. (#101023) ...

Implementation uses a fallback that does no coalescing.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/101023
Approved by: https://github.com/wanchaol

2023-06-23 19:24:11 +00:00

..

_composable

Fix composable checkpoint(use_reentrant=True) with multi args (#103590)

2023-06-14 21:53:30 +00:00

_shard

enforce dtype (reland) (#102996)

2023-06-06 00:35:04 +00:00

_sharded_tensor

[reland] Create torch.distributed._shard package. (#72141)

2022-02-02 06:58:20 +00:00

_sharding_spec

Add __all__ for a few distributed modules plus a little typing (reland) (#84872)

2022-09-13 21:57:49 +00:00

_spmd

[distributed] implemented find_all_descendants (#102138)

2023-05-24 21:47:59 +00:00

_tensor

[dtensor] support torch.save/load with DTensor (#103106)

2023-06-09 04:11:15 +00:00

_tools

Fix typos under torch/distributed directory (#95638)

2023-03-27 21:13:44 +00:00

algorithms

[CheckpointWrapper] Warn on reentrant use (#102890)

2023-06-04 18:31:22 +00:00

autograd

[BE]: pyupgrade Python to 3.8 - imports and object inheritance only (#94308)

2023-02-07 21:10:56 +00:00

benchmarks

[BE] [2/3] Rewrite super() calls in functorch and torch (#94588)

2023-02-10 21:16:33 +00:00

checkpoint

[DCP] Rewrite read slicing to use a wrapper. (#99167)

2023-06-08 13:52:13 +00:00

elastic

[BE] Fix flake8 B027 errors - missing abstractmethod decorator (#100715)

2023-05-09 17:28:48 +00:00

examples

Fix typos under torch/distributed directory (#95638)

2023-03-27 21:13:44 +00:00

fsdp

[FSDP][state_dict] Add a summary log when finishing state_dict (#103784)

2023-06-22 16:29:24 +00:00

launcher

Convert logging f-strings to use % format, part four (#98705)

2023-04-11 13:17:59 +00:00

nn

Add assign kwarg to module.load_state_dict (#102212)

2023-06-15 18:41:00 +00:00

optim

[FSDP][optim_state_dict] Cleanup the unused optimizer state_dict APIs (#103781)

2023-06-21 05:38:48 +00:00

pipeline

Enable ruff in lintrunner (#99785)

2023-04-24 16:18:44 +00:00

rpc

[BE]: enable PLE error codes in ruff and fix bugs (#101079)

2023-05-11 23:57:25 +00:00

tensor

[TP] Add an input resharding wrapper for TP and unit test for 2D + AC (#103334)

2023-06-23 04:05:01 +00:00

__init__.py

[c10d] Record time spent for init_process_group, new_group, _store_based_barrier (#101912)

2023-05-24 09:36:34 +00:00

_composable_state.py

[Composable API]Common _State parent class for composable and wrapper FSDP (#89147)

2022-12-13 23:58:01 +00:00

_functional_collectives.py

[C10D] Add functional collective reduce_scatter_into_tensor_coalesced. (#101023)

2023-06-23 19:24:11 +00:00

argparse_util.py

[19/n][torch/elastic][upstream] Replace pytorch.distributed.launch with torchelastic launcher (#56214)

2021-04-16 13:38:23 -07:00

c10d_logger.py

[c10d] Record time spent for init_process_group, new_group, _store_based_barrier (#101912)

2023-05-24 09:36:34 +00:00

constants.py

make ProcessGroupDefaultTimeout the same as python (#56549)

2021-04-21 17:56:05 -07:00

CONTRIBUTING.md

Fix some links in torch/distributed/CONTRIBUTING.md (#79855)

2022-06-21 00:48:30 +00:00

distributed_c10d.py

Implement coalesced reduce_scatter_tensor (#103561)

2023-06-15 20:11:12 +00:00

launch.py

Fix typos under torch/distributed directory (#95638)

2023-03-27 21:13:44 +00:00

logging_handlers.py

[C10D][BE] Add exception handlers to c10d collectives function (#87643) (#87988)

2022-10-29 04:38:34 +00:00

remote_device.py

[BE]: pyupgrade Python to 3.8 - imports and object inheritance only (#94308)

2023-02-07 21:10:56 +00:00

rendezvous.py

Revisit torch._six.string_classes removal (#94709) (#97863)

2023-03-30 17:02:45 +00:00

run.py

Convert logging f-strings to use % format, part four (#98705)

2023-04-11 13:17:59 +00:00

utils.py

[FSDP/DDP] Unify _cast_forward_inputs (#102680)

2023-06-04 18:31:21 +00:00