mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00

Files

Howard Huang 9de22bc5da Inspect schedule IR comms (#162996 )

Small change to util to allow us to see comms (e.g. `SEND`, `RECV`, etc.) in the schedule IR

Pull Request resolved: https://github.com/pytorch/pytorch/pull/162996
Approved by: https://github.com/fegin

2025-09-16 16:59:06 +00:00

__init__.py

[PP] Add DualPipeV schedule (#159591 )

2025-08-14 14:58:35 +00:00

_backward.py

[PP] Allow intermediate nodes in ZB to have multiple grads (#159084 )

2025-07-27 19:16:51 +00:00

_debug.py

remove allow-untyped-defs from torch/distributed/pipelining/_debug.py (#143871 )

2024-12-27 01:20:26 +00:00

_IR.py

Replace export_for_training with export (#162396 )

2025-09-10 14:19:34 +00:00

_schedule_visualizer.py

Inspect schedule IR comms (#162996 )

2025-09-16 16:59:06 +00:00

_unflatten.py

PEP585 update - torch/distributed (#145164 )

2025-01-21 04:23:29 +00:00

_utils.py

[PP] Support OVERLAP_F_B computation type (#158978 )

2025-08-01 20:22:30 +00:00

microbatch.py

[BE][Ez]: Optimize unnecessary lambda with operator (#154722 )

2025-05-30 23:47:10 +00:00

README.md

[pipelining] redirect README to document (#128205 )

2024-06-07 19:34:52 +00:00

schedules.py

[PP] Add profiling to schedule execution (#160753 )

2025-09-03 21:31:50 +00:00

stage.py

Add batch option for send/recv_object_list (#160342 )

2025-08-30 03:29:09 +00:00

README.md

Pipeline Parallelism for PyTorch

torch.distributed.pipelining is a package for implementing pipeline parallelism on your model.

Our documentation is available here.