Olatunji Ruwase e80ae08886 Empty ZeRO3 partition cache (#3060) ...

Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

2023-03-23 17:15:34 -07:00

..

activation-checkpointing.rst

ZeRO-2 (#217)

2020-05-19 01:00:53 -07:00

autotuning.rst

Add autotuning news post (#1565)

2021-11-15 20:08:38 -08:00

conf.py

add missing license info to top of all source code (#2889)

2023-02-27 11:20:41 -08:00

flops-profiler.rst

Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

2021-03-11 09:45:36 -08:00

index.rst

Refactor/Pydantify monitoring config (#2640)

2023-01-31 20:58:13 +00:00

inference-engine.rst

formatting fix

2021-05-24 23:10:59 +00:00

inference-init.rst

Refactor DS inference API. No longer need replace_method. (#2831)

2023-02-15 23:17:02 +00:00

initialize.rst

Fix many typos (#1423)

2021-10-01 19:56:32 -07:00

kernel.rst

Transformer kernel release (#242)

2020-05-29 13:15:36 -07:00

memory.rst

[memory estimators] new config args sync (#2431)

2022-10-19 20:31:27 -07:00

model-checkpointing.rst

[model weights] zero_to_fp32 multiple improvements (#1181)

2021-07-12 13:11:44 -07:00

moe.rst

Refactor MoE and Groups API to simplify model creation and mangement (#1798)

2022-02-28 11:46:40 -08:00

monitor.rst

Refactor/Pydantify monitoring config (#2640)

2023-01-31 20:58:13 +00:00

optimizers.rst

01 adam optimizer (#1790)

2022-03-10 21:31:18 -08:00

pipeline.rst

Render docs for pipe.ProcessTopology (#1505)

2021-11-17 20:23:11 -08:00

schedulers.rst

force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

2021-11-29 15:41:18 -08:00

training.rst

Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453)

2022-01-20 18:14:13 -08:00

zero3.rst

Empty ZeRO3 partition cache (#3060)

2023-03-23 17:15:34 -07:00