mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00

Files

Animesh Jain 07a4e9fea8 [benchmarks] Skip mobilenetv3_large_100 in CI for accuracy (#161570 )

To keep the CI green - https://github.com/pytorch/pytorch/issues/161419

Its unclear if this is a real failure. And debugging it is non trivial.
Skipping for now to keep the CI greenst

Pull Request resolved: https://github.com/pytorch/pytorch/pull/161570
Approved by: https://github.com/BoyuanFeng, https://github.com/zou3519

2025-08-27 03:44:04 +00:00

data

Dataloader benchmark script (#159432 )

2025-08-06 19:05:19 +00:00

distributed/ddp

[BE] Remove outdated RPC benchmark (#146716 )

2025-03-29 04:44:36 +00:00

dynamo

[benchmarks] Skip mobilenetv3_large_100 in CI for accuracy (#161570 )

2025-08-27 03:44:04 +00:00

fastrnns

[BE] fix typos in benchmarks/ (#156077 )

2025-06-17 13:12:18 +00:00

framework_overhead_benchmark

Fix unused Python variables outside torch/ and test/ (#136359 )

2024-12-11 17:10:23 +00:00

functional_autograd_benchmark

[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027 )

2025-07-09 11:24:27 +00:00

fuser

Fix unused Python variables outside torch/ and test/ (#136359 )

2024-12-11 17:10:23 +00:00

gpt_fast

[BE] fix typos in benchmarks/ (#156077 )

2025-06-17 13:12:18 +00:00

inductor_backends

Rename inductor cache (#156128 )

2025-06-17 03:57:18 +00:00

inference

[BE] fix typos in benchmarks/ (#156077 )

2025-06-17 13:12:18 +00:00

instruction_counts

[BE] add noqa for flake8 rule B036: found except BaseException without re-raising (#159043 )

2025-07-25 02:56:34 +00:00

nested

Fix unused Python variables outside torch/ and test/ (#136359 )

2024-12-11 17:10:23 +00:00

operator_benchmark

[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027 )

2025-07-09 11:24:27 +00:00

overrides_benchmark

[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754 )

2024-07-17 14:34:42 +00:00

profiler_benchmark

Apply TorchFix TOR203 fixes (#143691 )

2024-12-23 18:21:03 +00:00

record_function_benchmark

[Caffe2]Remove Caffe2 scripts and benchmarks (#126747 )

2024-06-05 23:46:31 +00:00

serialization

Fix unused Python variables outside torch/ and test/ (#136359 )

2024-12-11 17:10:23 +00:00

sparse

[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027 )

2025-07-09 11:24:27 +00:00

static_runtime

[3/N] Use internal linkage in C++ files (#151297 )

2025-05-05 17:48:39 +00:00

tensorexpr

[BE] fix typos in benchmarks/ (#156077 )

2025-06-17 13:12:18 +00:00

transformer

[BE] fix typos in benchmarks/ (#156077 )

2025-06-17 13:12:18 +00:00

compare-fastrnn-results.py

[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754 )

2024-07-17 14:34:42 +00:00

compare.sh

Benchmarks: add scripts for FastRNNs results comparison. (#44134 )

2020-09-03 13:44:42 -07:00

README.md

[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027 )

2025-07-09 11:24:27 +00:00

upload_scribe.py

Fix broken URLs (#152237 )

2025-04-27 09:56:42 +00:00

README.md

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
python -m pip install torch torchvision

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python -m pip install --no-build-isolation -v -e .

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite. Links are provided where descriptions exist: