frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
f2e6b0837ab977a6924cf060898c6c4a675cb25f
pytorch/benchmarks
History
Edward Z. Yang 97fc8ea5f4 Run the benchmark suite with dynamic batch only (#97912) 
Symbolic shapes compile time on full CI with inductor is horribly long (even though our aot_eager local runs seemed to suggest that the added latency was only 10s per model.) To patch over the problem for now, run the benchmark suite with dynamic batch only.  This should absolve a lot of sins.

Signed-off-by: Edward Z. Yang <ezyang@meta.com>

Pull Request resolved: https://github.com/pytorch/pytorch/pull/97912
Approved by: https://github.com/janeyx99, https://github.com/desertfire
2023-03-30 18:04:48 +00:00
..
cpp
moving nvfuser benchmark to third_party/nvfuser (#96725)
2023-03-21 23:19:15 +00:00
distributed
[BE]: Update flake8 and plugins and fix bugs (#97795)
2023-03-28 23:51:55 +00:00
dynamo
Run the benchmark suite with dynamic batch only (#97912)
2023-03-30 18:04:48 +00:00
fastrnns
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
framework_overhead_benchmark
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
functional_autograd_benchmark
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
fuser
Benchmarks for various fusers (#67622)
2021-11-04 18:57:17 -07:00
instruction_counts
[BE] Prefer dash over underscore in command-line options (#94505)
2023-02-09 20:16:49 +00:00
nested
Use tensor cores for NT bmm (#86856)
2022-11-02 21:51:40 +00:00
operator_benchmark
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
overrides_benchmark
Use classmethods for overrides (#64841)
2021-09-17 08:32:49 -07:00
profiler_benchmark
[BE] Prefer dash over underscore in command-line options (#94505)
2023-02-09 20:16:49 +00:00
record_function_benchmark
[BE] Prefer dash over underscore in command-line options (#94505)
2023-02-09 20:16:49 +00:00
serialization
[PyTorch] Add annotation_str benchmark (#96496)
2023-03-23 04:18:07 +00:00
sparse
[BE] Enable flake8-comprehension rule C417 (#97880)
2023-03-30 14:34:24 +00:00
static_runtime
Fix flaky StaticRuntime.Nonzero test (#94418)
2023-02-16 21:25:15 +00:00
tensorexpr
Fix usages of contextmanager without finally (#96170)
2023-03-08 20:59:27 +00:00
transformer
[BE] Prefer dash over underscore in command-line options (#94505)
2023-02-09 20:16:49 +00:00
compare-fastrnn-results.py
Benchmarks: add scripts for FastRNNs results comparison. (#44134)
2020-09-03 13:44:42 -07:00
compare.sh
Benchmarks: add scripts for FastRNNs results comparison. (#44134)
2020-09-03 13:44:42 -07:00
README.md
Add CSR (compressed sparse row) layout for sparse tensors (#50937)
2021-04-12 10:09:12 -07:00
upload_scribe.py
[BE] Prefer dash over underscore in command-line options (#94505)
2023-02-09 20:16:49 +00:00

README.md

PyTorch Benchmarks

This folder contains scripts that produce reproducible timings of various PyTorch features.

It also provides mechanisms to compare PyTorch with other frameworks.

Setup environment

Make sure you're on a machine with CUDA, torchvision, and pytorch installed. Install in the following order:

# Install torchvision. It comes with the pytorch stable release binary
conda install pytorch torchvision -c pytorch

# Install the latest pytorch master from source.
# It should supersede the installation from the release binary.
cd $PYTORCH_HOME
python setup.py build develop

# Check the pytorch installation version
python -c "import torch; print(torch.__version__)"

Benchmark List

Please refer to each subfolder to discover each benchmark suite