frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
ce467df5d1d763d1648aee51c93ce3e9a4699936
pytorch/benchmarks
History
Will Feng 8047cde0f3 Try to fix Inductor CI periodic tests (#160932) 
- hf_Reformer: this one starts failing due to increased graph breaks due to transformers pin bump (#159291). We can likely just bump the expected graph break count.
- dla102: this one starts timing out on 8/13 Wed between commit 6e8865f and ee1b041. But based on the PT2 dashboard, this model actually doesn't have compile time or runtime regression. Will try to bump up the timeout and see if it can work.
- hf_BigBird: this one has its accuracy status improved since today. Will update hf_BigBird accuracy status.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/160932
Approved by: https://github.com/zou3519, https://github.com/huydhn, https://github.com/malfet
2025-08-20 20:36:46 +00:00
..
data
Dataloader benchmark script (#159432)
2025-08-06 19:05:19 +00:00
distributed/ddp
[BE] Remove outdated RPC benchmark (#146716)
2025-03-29 04:44:36 +00:00
dynamo
Try to fix Inductor CI periodic tests (#160932)
2025-08-20 20:36:46 +00:00
fastrnns
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
framework_overhead_benchmark
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
functional_autograd_benchmark
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
fuser
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
gpt_fast
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
inductor_backends
Rename inductor cache (#156128)
2025-06-17 03:57:18 +00:00
inference
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
instruction_counts
[BE] add noqa for flake8 rule B036: found except BaseException without re-raising (#159043)
2025-07-25 02:56:34 +00:00
nested
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
operator_benchmark
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
overrides_benchmark
[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754)
2024-07-17 14:34:42 +00:00
profiler_benchmark
Apply TorchFix TOR203 fixes (#143691)
2024-12-23 18:21:03 +00:00
record_function_benchmark
[Caffe2]Remove Caffe2 scripts and benchmarks (#126747)
2024-06-05 23:46:31 +00:00
serialization
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
sparse
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
static_runtime
[3/N] Use internal linkage in C++ files (#151297)
2025-05-05 17:48:39 +00:00
tensorexpr
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
transformer
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
compare-fastrnn-results.py
[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754)
2024-07-17 14:34:42 +00:00
compare.sh
Benchmarks: add scripts for FastRNNs results comparison. (#44134)
2020-09-03 13:44:42 -07:00
README.md
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
upload_scribe.py
Fix broken URLs (#152237)
2025-04-27 09:56:42 +00:00

README.md

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
python -m pip install torch torchvision

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python -m pip install --no-build-isolation -v -e .

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite. Links are provided where descriptions exist: