Stas Bekman 4eb37729de add print_dist util (#7621) ...

a refactor follow up to
https://github.com/deepspeedai/DeepSpeed/pull/7617 as suggested by
@tohtana to create 2 independent utils, sharing the main logic via
another util.

Signed-off-by: Stas Bekman <stas@stason.org>

2025-10-03 19:30:26 -07:00

..

__init__.py

Improve leaf module interface (enable via config, relax matching criteria, add document, etc.) (#7604)

2025-10-03 09:45:28 +00:00

bwc.py

Support MoE for pipeline models (#5338)

2024-04-08 15:35:53 +00:00

comms_logging.py

Improvements to Communication Logger (#7404)

2025-07-09 13:35:28 -04:00

config.py

Add throughput timer configuration (#5363)

2024-05-22 20:28:02 +00:00

debug.py

Ulysses SP for HF Integration (#7268)

2025-05-31 07:25:23 +00:00

exceptions.py

Update DeepSpeed copyright license to Apache 2.0 (#3111)

2023-03-30 17:14:38 -07:00

groups.py

fix issues raised by Coverity scans (#7431)

2025-08-02 12:16:10 -04:00

init_on_device.py

Update DeepSpeed copyright license to Apache 2.0 (#3111)

2023-03-30 17:14:38 -07:00

logging.py

add print_dist util (#7621)

2025-10-03 19:30:26 -07:00

mixed_precision_linkage.py

Add API for updating ZeRO gradients (#6590)

2024-10-14 17:35:41 +00:00

numa.py

Modernize system executable detection across components (#7290)

2025-05-19 21:42:42 +00:00

nvtx.py

Avoid graph breaks by disabling sourceless calls in instrument_w_nvtx (#7081)

2025-03-03 22:54:08 +00:00

tensor_fragment.py

Fix invalid f-strings (#7457)

2025-08-16 18:22:19 +00:00

timer.py

add print_dist util (#7621)

2025-10-03 19:30:26 -07:00

torch.py

Stage3: Use new torch grad accumulation hooks API (#6773)

2025-01-03 07:48:24 -08:00

types.py

Hybrid Engine Refactor and Llama Inference Support (#3425)

2023-05-03 17:20:07 -07:00

z3_leaf_module.py

Improve leaf module interface (enable via config, relax matching criteria, add document, etc.) (#7604)

2025-10-03 09:45:28 +00:00

zero_to_fp32.py

Fix invalid f-strings (#7457)

2025-08-16 18:22:19 +00:00