frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 12:54:11 +08:00
Code Issues Packages Projects Releases Wiki Activity

Updated PyTorch OSS benchmark infra (markdown)

Huy Do
2025-06-16 13:11:26 -07:00
parent 3087ae6260
commit bacbeec881
1 changed files with 6 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
PyTorch-OSS-benchmark-infra.md

@ -300,6 +300,12 @@ The list of available benchmarks at the moment are:
"vllm-project/vllm": "vLLM benchmark"
```
### TorchAgent
To explore the benchmark database, we recommend trying out https://hud.pytorch.org/torchagent. You need to have write access to PyTorch to use the agent. At a high level, it includes our [clickhouse-mcp](https://github.com/izaitsevfb/clickhouse-mcp) that it can use to explore the database.
As an example, the list of available benchmarks comes from this prompt `List all the benchmark names from different GitHub repositories from Jun 10th to Jun 16th. Each name only needs to be mentioned once`
### Benchmark database
The benchmark database on ClickHouse Cloud is currently accessible to all Metamates. We also provide a [ClickHouse MCP server](https://github.com/izaitsevfb/clickhouse-mcp) that you can install to access the database via an AI agent like Claude Code.