frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 12:54:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
bcfe1b2d714cbb2716495e09ae010e7c34daf045
pytorch/benchmarks
History
Yiming Zhou 9d882fd9ff [benchmark] Add torchscript jit.trace to benchmark option (#161223) 
For comparing NativeRT and TorchScript. We add `torchscript-jit-trace` as an option in the benchmark. With this option, we can run trace a model and run inference with the traced module using TorchScript interpreter

```
python ./benchmarks/dynamo/huggingface.py --performance --inference --torchscript-jit-trace

python ./benchmarks/dynamo/timm_models.py --performance --inference --torchscript-jit-trace

python ./benchmarks/dynamo/torchbench.py --performance --inference --torchscript-jit-trace
```

Pull Request resolved: https://github.com/pytorch/pytorch/pull/161223
Approved by: https://github.com/huydhn
2025-08-22 21:38:28 +00:00
..
data
Dataloader benchmark script (#159432)
2025-08-06 19:05:19 +00:00
distributed/ddp
[BE] Remove outdated RPC benchmark (#146716)
2025-03-29 04:44:36 +00:00
dynamo
[benchmark] Add torchscript jit.trace to benchmark option (#161223)
2025-08-22 21:38:28 +00:00
fastrnns
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
framework_overhead_benchmark
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
functional_autograd_benchmark
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
fuser
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
gpt_fast
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
inductor_backends
Rename inductor cache (#156128)
2025-06-17 03:57:18 +00:00
inference
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
instruction_counts
[BE] add noqa for flake8 rule B036: found except BaseException without re-raising (#159043)
2025-07-25 02:56:34 +00:00
nested
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
operator_benchmark
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
overrides_benchmark
[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754)
2024-07-17 14:34:42 +00:00
profiler_benchmark
Apply TorchFix TOR203 fixes (#143691)
2024-12-23 18:21:03 +00:00
record_function_benchmark
[Caffe2]Remove Caffe2 scripts and benchmarks (#126747)
2024-06-05 23:46:31 +00:00
serialization
Fix unused Python variables outside torch/ and test/ (#136359)
2024-12-11 17:10:23 +00:00
sparse
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
static_runtime
[3/N] Use internal linkage in C++ files (#151297)
2025-05-05 17:48:39 +00:00
tensorexpr
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
transformer
[BE] fix typos in benchmarks/ (#156077)
2025-06-17 13:12:18 +00:00
compare-fastrnn-results.py
[BE][Easy][3/19] enforce style for empty lines in import segments in benchmarks/ (#129754)
2024-07-17 14:34:42 +00:00
compare.sh
Benchmarks: add scripts for FastRNNs results comparison. (#44134)
2020-09-03 13:44:42 -07:00
README.md
[build] modernize build-frontend: python setup.py develop/install -> [uv ]pip install --no-build-isolation [-e ]. (#156027)
2025-07-09 11:24:27 +00:00
upload_scribe.py
Fix broken URLs (#152237)
2025-04-27 09:56:42 +00:00

README.md

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
python -m pip install torch torchvision

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python -m pip install --no-build-isolation -v -e .

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite. Links are provided where descriptions exist: