frozenleaves/accelerate
1
0
Fork 0
mirror of https://github.com/huggingface/accelerate.git synced 2025-10-20 18:13:46 +08:00
Code Issues Packages Projects Releases Wiki Activity

Simplify test logic (#2697)

Browse Source 
* simplify test logic 😅

* 😅
This commit is contained in:
Sourab Mangrulkar
2024-04-23 02:49:55 +05:30
committed by GitHub
parent baafaf4a6e
commit ef0f62c12a
1 changed files with 2 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
src/accelerate/test_utils/scripts/test_distributed_data_loop.py
View File

@ -255,9 +255,8 @@ def test_data_loader(data_loader, accelerator):
sorted_all_examples = sorted(all_examples)
# Check if all elements are present in the sorted list of iterated samples
label_data = list(range(NUM_ELEMENTS))
assert set(sorted_all_examples).intersection(set(label_data)) == set(
label_data
assert (
len(set(sorted_all_examples)) == NUM_ELEMENTS
), "Not all the dataset elements have been iterated in an epoch due to duplication of samples across processes."