Numbers based TD (#119901)

Convert from a list/bucket based TD system to just a numbers based TD system.  Looks like a massive change but a decent amount of it is tests and removing code.

Main file of interest is interface.py, which Github is collapsing by default due to size

The test files pretty much got rewritten entirely since a lot of the old tests are no longer relevant.

Other notable changes:
* Use Frozenset to make TestRun hashable
* Adds tools/test/heuristics/__init__.py to ensure that unittest can discover the tests
Pull Request resolved: https://github.com/pytorch/pytorch/pull/119901
Approved by: https://github.com/osalpekar, https://github.com/huydhn
This commit is contained in:
Catherine Lee
2024-02-26 17:01:19 +00:00
committed by PyTorch MergeBot
parent 86063b4d03
commit c39bbd6def
18 changed files with 742 additions and 1297 deletions

View File

@ -3,7 +3,7 @@ import os
import subprocess
from pathlib import Path
from typing import Callable, Dict, List, Optional, Sequence, Set, Tuple
from typing import Callable, Dict, FrozenSet, List, Optional, Sequence, Tuple
from tools.stats.import_test_stats import get_disabled_tests, get_slow_tests
from tools.testing.test_run import ShardedTest, TestRun
@ -91,7 +91,7 @@ def get_duration(
return file_duration
def get_duration_for_classes(
test_file: str, test_classes: Set[str]
test_file: str, test_classes: FrozenSet[str]
) -> Optional[float]:
duration: float = 0