Olatunji Ruwase 889f0ead27 Enable non-ZeRO mode (#7515) ...

Enabled via `stage=0` which corresponds to DDP. 
Remove hardwired path to b16_optimizer.
Enable`torch.autocast` for DDP training
Enable native mixed precision DDP for bfloat16
Update torch.autocast and native mixed precision UTs

<img width="976" height="184" alt="image"
src="https://github.com/user-attachments/assets/92904cdc-e312-46a4-943f-011eb5ab146a"
/>

---------

Signed-off-by: Olatunji Ruwase <tunji.ruwase@snowflake.com>
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

2025-08-27 14:07:29 -04:00

..

source

Enable non-ZeRO mode (#7515)

2025-08-27 14:07:29 -04:00

build-api-docs.sh

drafting Jekyll webpage (#143)

2020-03-17 13:49:48 -07:00

Makefile

drafting Jekyll webpage (#143)

2020-03-17 13:49:48 -07:00