mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00

Files

Tugsbayasgalan Manlaibaatar c73f5080de Migrating some more callsites (#163580 )

Pull Request resolved: https://github.com/pytorch/pytorch/pull/163580
Approved by: https://github.com/avikchaudhuri
ghstack dependencies: #165582

2025-10-19 15:52:17 +00:00

2025-10-19 15:52:17 +00:00

2024-10-26 16:27:55 +00:00

__init__.py

2024-08-12 05:20:26 +00:00

benchmark_runner.sh

2025-02-08 18:00:40 +00:00

check_results.py

2025-08-14 09:11:27 +00:00

expected_results.csv

2025-10-19 15:52:17 +00:00

log_benchmarking_time.py

2024-09-14 16:45:52 +00:00

README.md

2025-09-27 03:26:59 +00:00

Instructions on how to make a new compile time benchmark

Make a new benchmark file in /benchmarks/dynamo/pr_time_benchmarks/benchmarks/ eg. 0b75b7ff2b/benchmarks/dynamo/pr_time_benchmarks/benchmarks/add_loop.py
cd into the pr_time_benchmarks directory cd benchmarks/dynamo/pr_time_benchmarks
Run PYTHONPATH=./ python benchmarks/[YOUR_BENCHMARK].py a.txt
(Optional) flip a flag that you know will change the benchmark and run again with b.txt PYTHONPATH=./ python benchmarks/[YOUR_BENCHMARK].py a.txt
Compare a.txt and b.txt located within the benchmarks/dynamo/pr_time_benchmarks folder to make sure things look as you expect
Check in your new benchmark file and submit a new PR
In a few days, if your benchmark is stable, bug Laith Sakka to enable running your benchmark on all PRs. If you are a meta employee, you can find the dashboard here: https://internalfb.com/intern/unidash/dashboard/pt2_diff_time_metrics