Zach Mueller 8039158d71 Torchao float8 training (#3348) ...

* Bookmark

* bookmark

* Add torchao base example

* Currently broken

* Clean

* DDP varient working

* FSDP as well

* Works for all but zero3

* Bookmark: currently zero3 is underperforming

* Bookmark

* Another diff

* Fin

* Fin

* Add req huggingface suite

* update tests for fp8/torchao/ddp

* Log FP8 backend used and adjust typing

* add documentation for convert_to_float8_training

* Rename to convert_model_to_fp8_ao

* Call superinit"

* Add types

* Clean

* Use filter_first_and_last_linear_layers

* Update usage guide docs

* Actually loop through the zero stages

* Clean

2025-02-17 11:51:47 -05:00

..

basic_tutorials

Bye bye torch <2 (#3331)

2025-01-09 12:11:08 -05:00

concept_guides

[docs] update set-seed (#3228)

2024-12-06 10:38:59 -05:00

imgs

Add Profiler Support for Performance Analysis (#2883)

2024-07-01 18:01:09 -04:00

package_reference

fix: typos in documentation files (#3388)

2025-02-10 13:11:50 -05:00

usage_guides

Torchao float8 training (#3348)

2025-02-17 11:51:47 -05:00

_toctree.yml

POC: multiple model/configuration DeepSpeed support (#3097)

2024-09-13 07:28:06 -04:00

index.md

[docs] Doc sprint (#3099)

2024-09-11 13:31:47 -04:00

quicktour.md

fix: typos in documentation files (#3388)

2025-02-10 13:11:50 -05:00