frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 12:54:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
b6852778ffd4db1c507aeb098f0c2493a03816de
pytorch/benchmarks
History
Nichols A. Romero 0298ebc97a [ROCm][inductor][dashboard] Add GPT2ForSequenceClassification to use_larger_multiplier_for_smaller_tensor list (#160001) 
GPT2ForSequenceClassification Hugging Face (HF) model fails on ROCm for bfloat16. The failure is numerically small.  This PRs adds this model to an exception list for small tensors. The exception list already includes two models. This increases the multiplier factor to 10.0 instead of 3 (default) for this model used in `torch/_dynamo/utils.py`.

In the PR comment below, I include a short analysis of the numerics.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/160001
Approved by: https://github.com/anijain2305, https://github.com/jataylo, https://github.com/jeffdaily
2025-08-18 15:33:30 +00:00
..
data
Dataloader benchmark script (#159432)
2025-08-06 19:05:19 +00:00
distributed/ddp
[BE] Remove outdated RPC benchmark (#146716)
2025-03-29 04:44:36 +00:00
dynamo
[ROCm][inductor][dashboard] Add GPT2ForSequenceClassification to use_larger_multiplier_for_smaller_tensor list (#160001)
2025-08-18 15:33:30 +00:00
fastrnns
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
framework_overhead_benchmark
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
functional_autograd_benchmark
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
fuser
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
gpt_fast
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
inductor_backends
Rename inductor cache (#156128)
2025-06-17 03:57:18 +00:00
inference
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
instruction_counts
[BE] add noqa for flake8 rule B036: found except BaseException without re-raising (#159043)
2025-07-25 02:56:34 +00:00
nested
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
operator_benchmark
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
overrides_benchmark
[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754)
2024-07-17 14:34:42 +00:00
profiler_benchmark
Apply TorchFix TOR203 fixes (#143691)
2024-12-23 18:21:03 +00:00
record_function_benchmark
[Caffe2]Remove Caffe2 scripts and benchmarks (#126747)
2024-06-05 23:46:31 +00:00
serialization
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
sparse
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
static_runtime
[3/N] Use internal linkage in C++ files (#151297)
2025-05-05 17:48:39 +00:00
tensorexpr
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
transformer
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
compare-fastrnn-results.py
[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754)
2024-07-17 14:34:42 +00:00
compare.sh
Benchmarks: add scripts for FastRNNs results comparison. (#44134)
2020-09-03 13:44:42 -07:00
README.md
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
upload_scribe.py
Fix broken URLs (#152237)
2025-04-27 09:56:42 +00:00

README.md

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
python -m pip install torch torchvision

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python -m pip install --no-build-isolation -v -e .

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite. Links are provided where descriptions exist: