frozenleaves/DeepSpeed
1
0
Fork 0
mirror of https://github.com/deepspeedai/DeepSpeed.git synced 2025-10-20 23:53:48 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,857 Commits 821 Branches 112 Tags
8e64c3b5509c1251fbd0956e28a3079f8bec4aee
Commit Graph

9 Commits

Author SHA1 Message Date
Hongjiu "Enneamer" Zhang
8e64c3b550 feat: add Lion optimizer (#4331) 
Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
 2023-10-05 22:32:14 +00:00
Michael Wyatt
b361c72761 Update DeepSpeed copyright license to Apache 2.0 (#3111) 
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
 2023-03-30 17:14:38 -07:00
Jeff Rasley
da84e60d98 add missing license info to top of all source code (#2889) 
Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
Co-authored-by: Conglong Li <conglong.li@gmail.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
 2023-02-27 11:20:41 -08:00
Connor Holmes
a25c31b67d Update AVX512 Detection (#2621) 
* Update cpuinfo AVX512 detection

* Missing conversion from `_mm256` to `_mm256i`

Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
 2022-12-17 05:57:28 -08:00
Reza Yazdani
a04480e192 Fix the half-precision version of CPU-Adam (#2032) 
* Fix the half-precision version of CPU-Adam

* remove unexpected return

* fix the increase width (fp32/fp16)

* support fp16 tests for cpu-adam

* fix the fp16 data-loading

* change unit-test for fp16 check & slight change to parameter size

* fix for numpy error

Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
 2022-06-23 08:56:26 -07:00
Reza Yazdani
259936a76c Fix cpu-adam AVX performance (#1637) 2021-12-14 17:33:48 -08:00
Jeff Rasley
a10e4811fe force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598) 2021-11-29 15:41:18 -08:00
Reza Yazdani
af443f63f4 CPU-Adam: Fix compile Issue (#1537) 
* fixing the softmax masking when using triangular masking

* move the TILE declaration outside of the SIMD loop

* remove unrelated changes

* fix Adagrad compile issue
 2021-11-09 11:45:01 -08:00
Wenhao Hu
8abdaee243 Add cpu adagrad (#1358) 
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>
Co-authored-by: Reza Yazdani <44502768+RezaYazdaniAminabadi@users.noreply.github.com>
 2021-10-26 17:55:17 +00:00