Wanchao Liang 0431d47eaa [tp] propagate src_data_rank kwarg in TP API (#144005) ...

as titled, this PR propagates the src_data_rank in the TP API, so that
module level APIs could leverage the flexibility to choose
src_data_rank, and avoid the communication if it does not need to

Pull Request resolved: https://github.com/pytorch/pytorch/pull/144005
Approved by: https://github.com/tianyu-l
ghstack dependencies: #143883

2025-01-02 05:35:52 +00:00

..

__init__.py

Move tensor_parallel out to distributed.tensor folder (#89878)

2022-11-30 22:13:10 +00:00

test_micro_pipeline_tp.py

[micro_pipeline_tp] don't pass return_A to fused_all_gather_scaled_matmul (#143782)

2024-12-24 07:25:38 +00:00

test_parallelize_api.py

[tp] propagate src_data_rank kwarg in TP API (#144005)

2025-01-02 05:35:52 +00:00

test_tp_examples.py

Fix unused Python variables in test/[a-d]* (#134665)

2024-12-13 22:13:12 +00:00

test_tp_random_state.py

[reland][dtensor] move DTensor to public namespace (#134203)

2024-09-08 17:08:40 +00:00

test_tp_style.py

Fix unused Python variables in test/[a-d]* (#134665)

2024-12-13 22:13:12 +00:00