5002e56704
Update quality tools to 2023 ( #1046 )
...
* Setup 2023 tooling for quality
* Result of styling
* Simplify inits and remove isort and flake8 from doc
* Puts back isort skip flag
2023-02-07 13:34:05 -05:00
1d9bcdd39d
Efficiently skip batches in a dataloader ( #1002 )
...
* Efficiently skip batches in a dataloader
* Add method in Accelerator and example
* Apply suggestions from code review
Co-authored-by: Zachary Mueller <muellerzr@gmail.com >
* Rename point of access
* Add point of access to init
* Add tests
* Don't forget to include fixes silly!
* Adapt examples
* Fix quality
* Forgot one
* fix method name
* Fix DataLoaderShard reinstantation
* Fix for epoch checkpointing
---------
Co-authored-by: Zachary Mueller <muellerzr@gmail.com >
2023-01-30 11:56:59 -05:00
f0f348921d
Don't force mixed precision as no in examples ( #1018 )
2023-01-27 10:12:27 -05:00
36420f53f3
remove check for main process for trackers initialization ( #643 )
...
* remove check for main process for trackers initialization
* removed is_main_process check for trackers initialization
2022-08-20 07:08:22 -04:00
e31d8ecaf1
minor tracker fixes for complete* examples ( #630 )
...
* minor tracker fixes for complete* examples
* state repr minor fix
2022-08-12 21:32:22 +05:30
8944975a3c
Reenable Gather for Metrics ( #590 )
...
* Clean and finish
Co-authored-by: Sylvain Gugger <Sylvain.gugger@gmail.com >
2022-08-02 13:45:17 -04:00
7f5c60c182
Use main_process_first in the examples ( #581 )
2022-07-28 12:11:07 -04:00
503057132d
Skip and raise NotImplementedError for gather_for_metrics for now ( #580 )
...
* Skip and raise NotImplementedError for now
2022-07-28 11:56:00 -04:00
e0212893ea
Fix gather_for_metrics ( #578 )
...
* Fix gather_for_metrics
2022-07-27 14:20:52 -04:00
7d97e9c641
add on_main_process decorators ( #488 )
...
* add some useful decorators
* make on_(local_)main_process member of Accelerator
* update examples
* add on_process and on_local_process
* fixes wrong name for `on_local_process`
* Update src/accelerate/accelerator.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* Update src/accelerate/accelerator.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* Update src/accelerate/accelerator.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2022-07-26 13:14:35 +02:00
164943c7d7
Add a gather_for_metrics capability ( #540 )
...
* Add test and full implementation
2022-07-21 07:40:37 -04:00
deffaba8d6
add use_distributed property ( #487 )
...
* add distributed property in accelerate_state
* ensure num_process > 1
2022-07-05 09:19:44 -04:00
1f96f3cf85
Rm gradient accumulation on TPU ( #479 )
...
* Rm gradient accumulation on TPU for now
2022-06-28 12:29:58 -04:00
775bc790e7
Cleanup CI Warnings ( #465 )
...
* Fix named tuple warning
* Use torch AdamW instead of transformers
* Make regex string instead of literal
2022-06-23 10:06:19 -04:00
d04e8e2baa
Switch to evaluate for metrics ( #417 )
...
* Switch to evaluate for metrics
* Why the heck?
* Fix syntax error
* Install from githug
* Is this the culprit?
* Upgrade Python
* Protobouf 💩
* Install from git not necessary now
* Sneaky last tensorboard
* Let's try this way
* Forgot to add all files :-/
2022-06-01 09:57:57 -04:00
d1f7f99684
improve metrics logged in examples ( #399 )
2022-05-26 17:29:49 +05:30
4736c754bf
fix tracking ( #361 )
...
* fixing trackers
* quality
* bug fix
* bug fix
* addressing comments and fixing tests
* Fixing script diff test
2022-05-13 17:20:27 +05:30
b5b68fbb4d
Fixing metric eval in distributed setup ( #355 )
2022-05-10 17:17:22 +05:30
d190ed7e41
Fix sample calculation in examples ( #352 )
...
* Fix metric calculation across examples
2022-05-09 15:44:49 -04:00
3e14dd16be
Fixup all checkpointing examples ( #323 )
2022-04-21 14:25:10 -04:00
209db19dc8
Create a testing framework for example scripts and fix current ones ( #313 )
...
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2022-04-13 13:24:36 -04:00
38e6d941fa
Update example scripts ( #307 )
...
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2022-04-04 17:19:25 -04:00
