Markus Hoehnerbach 6085bf7565 [inductor] allocate non-blocking copy destinations in pinned memory (#155121) (#158758) ...

Fixes #155121

Pull Request resolved: https://github.com/pytorch/pytorch/pull/158758
Approved by: https://github.com/EikanWang, https://github.com/eellison

2025-08-04 21:22:11 +00:00

..

analysis

[BE][2/16] fix typos in torch/ (torch/_*/) (#156312)

2025-07-12 05:47:06 +00:00

autoheuristic

[BE][Ez]: Optimize unnecessary lambda with operator (#154722)

2025-05-30 23:47:10 +00:00

codegen

[inductor] allocate non-blocking copy destinations in pinned memory (#155121) (#158758)

2025-08-04 21:22:11 +00:00

compile_worker

Name Inductor's Subproc pool threads. (#158815)

2025-07-28 16:08:08 +00:00

fx_passes

[bucketing] Reduce CPU overhead for reduce_scatter_merge_fn_to_trace (#159723)

2025-08-03 09:16:55 +00:00

kernel

Revert "[inductor] consolidate common GEMM triton param retrieval (#159383)"

2025-08-01 19:49:21 +00:00

package

Grab bag of (mostly) typing improvements (#158075)

2025-07-21 19:17:01 +00:00

runtime

Fix warnings in triton_helpers.py (#159719)

2025-08-04 03:21:09 +00:00

__autotune_main__.py

Improve subproc autotuning implementation (#149700)

2025-03-28 01:06:39 +00:00

__init__.py

Grab bag of (mostly) typing improvements (#158075)

2025-07-21 19:17:01 +00:00

analyze_preserves_zero_mask.py

Revert two recent prologue prs (#151013)

2025-04-10 23:48:41 +00:00

aoti_eager.py

PEP585 update - torch/_inductor/[_-i]* (#145137)

2025-01-19 01:22:47 +00:00

async_compile.py

Add size_hints to cache key (#158026)

2025-07-11 01:47:50 +00:00

autotune_process.py

[BE][3/16] fix typos in torch/ (torch/_inductor/) (#156313)

2025-06-23 02:57:12 +00:00

bounds.py

[inductor] Refactor op handlers part 5 (#146257)

2025-02-08 18:00:30 +00:00

choices.py

Revert "[inductor] consolidate common GEMM triton param retrieval (#159383)"

2025-08-01 19:49:21 +00:00

codecache.py

S390X: fix detection of magic number placeholder in inductor (#157784)

2025-08-04 12:42:31 +00:00

comm_analysis.py

[cpp wrapper] add AOTI shim for collective ops (#154492)

2025-06-25 01:20:05 +00:00

comm_lowering.py

[inductor] Add typing to _inductor/ir.py (#149958)

2025-06-30 15:56:35 +00:00

comms.py

[inductor] Fix collectives_reordering overwrite real_dep with fake_dep with the same name (#158960)

2025-07-24 11:08:58 +00:00

compile_fx_async.py

[pc] introduce ProgressiveCompilationState and clear callback (#157619)

2025-07-05 07:55:11 +00:00

compile_fx_ext.py

Migrate from lru_cache to cache (#155613)

2025-06-11 19:44:18 +00:00

compile_fx_subproc.py

Rename inductor cache (#156128)

2025-06-17 03:57:18 +00:00

compile_fx.py

[inductor] Add logging for distributed collective ops for multi‑rank diagnostics (#159190)

2025-08-01 21:51:42 +00:00

compiler_bisector.py

Migrate from lru_cache to cache (#155613)

2025-06-11 19:44:18 +00:00

config.py

Add torch compile force disable caches alias (#158072)

2025-08-02 23:23:17 +00:00

constant_folding.py

Add dont constant fold flag (#154945)

2025-06-10 14:52:26 +00:00

cpp_builder.py

[AOTI] add zero size consts asm handler (#159225)

2025-07-31 22:46:33 +00:00

cpu_vec_isa.py

mypy 1.16.0 (#155821)

2025-06-14 18:18:43 +00:00

cudagraph_trees.py

Fix types in graphs.py (#158192)

2025-07-15 19:49:38 +00:00

cudagraph_utils.py

[BE][3/16] fix typos in torch/ (torch/_inductor/) (#156313)

2025-06-23 02:57:12 +00:00

custom_graph_pass.py

[BE][3/16] fix typos in torch/ (torch/_inductor/) (#156313)

2025-06-23 02:57:12 +00:00

debug.py

[inductor] Add logging for distributed collective ops for multi‑rank diagnostics (#159190)

2025-08-01 21:51:42 +00:00

decomposition.py

Fix rand_like decomposition to preserve strides (#159294)

2025-08-02 03:54:41 +00:00

dependencies.py

DDE-Free select with unbacked index. (#157605)

2025-07-24 20:08:05 +00:00

dtype_propagation.py

Migrate from lru_cache to cache (#155613)

2025-06-11 19:44:18 +00:00

exc.py

PEP585 update - torch/_inductor/[_-i]* (#145137)

2025-01-19 01:22:47 +00:00

extern_node_serializer.py

[BE][AOTI] Remove duplicate schema for ExternKernelNode (#155867)

2025-06-14 02:03:27 +00:00

freezing_utils.py

PEP585: More UP006 fixes (#146392)

2025-02-20 06:18:13 +00:00

freezing.py

mypy 1.16.0 (#155821)

2025-06-14 18:18:43 +00:00

fuzzer.py

Automatically load and save dynamo entries via caching_precompile (#155913)

2025-07-07 23:57:17 +00:00

fx_utils.py

Inductor logging + analysis of torch.profile (#149697)

2025-07-07 22:13:34 +00:00

graph.py

[inductor] respect layout tags for ops with registered lowerings (#159134)

2025-07-31 21:29:40 +00:00

hooks.py

PEP585 update - torch/_inductor/[_-i]* (#145137)

2025-01-19 01:22:47 +00:00

index_propagation.py

[BE][3/16] fix typos in torch/ (torch/_inductor/) (#156313)

2025-06-23 02:57:12 +00:00

inductor_prims.py

[inductor] lowering for fractional_max_pool3d (#148630)

2025-05-22 16:06:29 +00:00

ir.py

[inductor] allocate non-blocking copy destinations in pinned memory (#155121) (#158758)

2025-08-04 21:22:11 +00:00

jagged_lowerings.py

Fix XPU CI UT test_circular_dependencies (#158189)

2025-07-13 09:30:57 +00:00

loop_body.py

Migrate from lru_cache to cache (#155613)

2025-06-11 19:44:18 +00:00

lowering.py

[inductor] respect layout tags for ops with registered lowerings (#159134)

2025-07-31 21:29:40 +00:00

memory.py

ban fusion of large amount of reads (#158667)

2025-07-21 21:00:40 +00:00

metrics.py

Replace runtime type parameterization (#155221)

2025-06-05 21:43:54 +00:00

mkldnn_ir.py

[inductor] Add typing to _inductor/ir.py (#149958)

2025-06-30 15:56:35 +00:00

mkldnn_lowerings.py

[Inductor][Float8] Add float8_e4m3fn into assertion dtype list. (#157684)

2025-07-15 06:02:01 +00:00

mock_cache.py

PEP585 update - torch/_inductor (#145198)

2025-01-21 21:04:33 +00:00

ops_handler.py

[inductor] Add typing to _inductor/ir.py (#149958)

2025-06-30 15:56:35 +00:00

optimize_indexing.py

PEP585 update - torch/_inductor (#145198)

2025-01-21 21:04:33 +00:00

output_code.py

Add user annotation for FX graph cache key (#159318)

2025-07-30 05:52:50 +00:00

pattern_matcher.py

[Dynamo][Better Engineering] Add typing annotations to guard and source (#158397) (#159491)

2025-07-30 22:57:50 +00:00

quantized_lowerings.py

[BE][1/X] Phase out usage of use_max_autotune() (#155847)

2025-06-14 03:16:20 +00:00

remote_cache.py

pt2_remote_cache: Log sample for failures, and log the explicit reason we're faling. (#156874)

2025-07-18 20:28:27 +00:00

scheduler.py

[Graph Partition] add log for graph partition reasons and #partitions (#159425)

2025-07-31 04:21:06 +00:00

script.ld

Place .lrodata later in the binary (#117575)

2024-01-18 17:58:18 +00:00

select_algorithm.py

Log autotune choices and benchmark result to scuba/chrome trace (#159496)

2025-08-02 05:34:17 +00:00

sizevars.py

multi-kernel matmuls based on varying hint sizes (#156628)

2025-07-12 15:08:21 +00:00

standalone_compile.py

[Dynamo][Better Engineering] Add typing annotations to guard and source (#158397) (#159491)

2025-07-30 22:57:50 +00:00

subgraph_lowering.py

Fix XPU CI UT test_circular_dependencies (#158189)

2025-07-13 09:30:57 +00:00

template_heuristics.py

Revert "[inductor] consolidate common GEMM triton param retrieval (#159383)"

2025-08-01 19:49:21 +00:00

test_case.py

Rename inductor cache (#156128)

2025-06-17 03:57:18 +00:00

test_operators.py

[BE] remove torch deploy - conditionals (#158288)

2025-07-29 17:40:49 +00:00

tiling_utils.py

[BE][3/16] fix typos in torch/ (torch/_inductor/) (#156313)

2025-06-23 02:57:12 +00:00

triton_bundler.py

[BE][3/16] fix typos in torch/ (torch/_inductor/) (#156313)

2025-06-23 02:57:12 +00:00

utils.py

Output tensor meta data for FX graph node (#159311)

2025-08-01 21:40:29 +00:00

virtualized.py

[inductor] Add a helper for convert index_dtype to torch dtype (#149531)

2025-03-20 21:33:29 +00:00

wrapper_benchmark.py

[inductor] Make times and repeat parameters command line args (#158590)

2025-07-18 20:07:55 +00:00