soulitzer e41a0b33ec Allow Fakified subclass to have different device for inner and outer tensor (#141839) ...

Previously if a wrapper tensor subclass is fakified, the inner tensors would end up having the same device as the outer tensor. This PR makes it so that inner and outer tensors can have different devices.

See OffloadTensor PR https://github.com/pytorch/pytorch/pull/141840/files#diff-3bc0cf540b694f4ec0a3749f78b047456657a53a5657e495ffb68e5970c5fdaaR1955 for an application. A simpler test has been added in this PR.

This is technically bc-breaking because now the callback passed to MetaConverter needs to accept an extra argument, but no one external should be using this anyway?
Pull Request resolved: https://github.com/pytorch/pytorch/pull/141839
Approved by: https://github.com/bdhirsh
ghstack dependencies: #141166

2024-12-03 00:09:41 +00:00

..

ao/sparsity

Run only listed tests on s390x (#140265)

2024-11-20 22:53:09 +00:00

autograd

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

backends/xeon

…

benchmark_utils

c10::optional -> std::optional in PyTorch (#137333)

2024-10-11 00:16:10 +00:00

bottleneck_test

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

cpp

[1/N] Decouple Flight Recorder from NCCL utils (#141648)

2024-11-27 18:29:42 +00:00

cpp_api_parity

Fix failures when default is flipped for weights_only (#127627)

2024-08-16 00:22:43 +00:00

cpp_extensions

OpenReg: Fix releasing tensor issue when exiting process (#140936)

2024-11-22 13:50:35 +00:00

custom_backend

[5/N][Easy] fix typo for usort config in pyproject.toml (kown -> known): sort torch (#127126)

2024-05-27 14:49:57 +00:00

custom_operator

C10_UNUSED to [[maybe_unused]] (#6357) (#138364)

2024-10-19 13:17:43 +00:00

distributed

Revert "ILP for auto FSDP wrapping (#140298)"

2024-12-02 14:08:04 +00:00

distributions

fix test_save_load_transform. (#140494)

2024-11-19 04:36:06 +00:00

dynamo

[dynamo][NFC] Rename NewCellVariable to CellVariable (#141628)

2024-12-02 19:09:30 +00:00

dynamo_expected_failures

[dynamo] Fix VariableBuilder._wrap on frozenset and enforce invariants on ConstantVariable (#141504)

2024-11-27 21:58:35 +00:00

dynamo_skips

config: Add env_name_default and env_name_force to Config (#138956)

2024-11-06 21:20:42 +00:00

edge

Set RUNPATH so installed tests can find the required shared libraries (#136627)

2024-10-25 09:38:08 +00:00

error_messages

[Ez][BE]: Enable new stable ruff rules (#129825)

2024-07-02 14:47:10 +00:00

expect

[export] Add device and dtype fields to assert_tensor_metadata (#141071)

2024-11-22 20:54:55 +00:00

export

[export] Generate compatible thrift schema out of schema.py (#141611)

2024-11-29 20:09:49 +00:00

forward_backward_compatibility

[BC] Add check for core ATen opset schema BC (#137664)

2024-10-18 01:58:33 +00:00

functorch

[hop] add discard_graph_changes to remove the empty calls before hop (#140334)

2024-11-26 17:32:43 +00:00

fx

Revert "Refactor FxGraphDrawer to use HTML-like labels (#137726)"

2024-11-04 17:44:44 +00:00

higher_order_ops

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

inductor

Revert "[inductor][pattern matcher] revise mkldnn pattern matcher UT (#141334)"

2024-12-02 21:29:02 +00:00

jit

remove skips due to https://github.com/pytorch/torchdynamo/issues/1991 (#138133)

2024-10-17 17:42:46 +00:00

jit_hooks

[BE][Easy][13/19] enforce style for empty lines in import segments in test/j*/ (#129764)

2024-08-01 12:13:42 +00:00

lazy

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

mobile

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

nn

[BE] Replace skipIfMPS with expectedFailureMPS (#139940)

2024-11-15 03:48:37 +00:00

onnx

[ONNX] Remove special handling of torchvision.ops imports in onnx export (#141569)

2024-11-28 18:05:40 +00:00

optim

Allow SequentialLR to include ChainedScheduler (#133450)

2024-10-18 02:29:38 +00:00

package

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

profiler

[9/N] Don't skip ASAN on some tests (#141534)

2024-11-26 23:52:53 +00:00

quantization

[PT2E Quantization] Fix RecursionError when prepare_pt2e graph with concat of the same node (#141651)

2024-11-29 09:19:22 +00:00

scripts

[BE][Easy] enable ruff rule PIE790: unnecessary pass statement (#133200)

2024-08-15 15:50:19 +00:00

test_img

…

torch_np

Update test_multiarray.py to support numpy 2.0+ (#138461)

2024-10-28 04:30:50 +00:00

typing

[BE][Easy][7/19] enforce style for empty lines in import segments in test/[a-c]*/ and test/[q-z]*/ (#129758)

2024-07-31 10:54:03 +00:00

xpu

Populate submodules of torch._C to sys.modules recursively (#132216)

2024-08-08 10:20:25 +00:00

_test_bazel.py

…

allowlist_for_publicAPI.json

Refactor ShapeGuardPrinter for future C++ addiiton (#140968)

2024-11-27 20:09:58 +00:00

conftest.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

create_dummy_torchscript_model.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

delete.py

…

hi.py

…

HowToWriteTestsUsingFileCheck.md

[Docs] Update FileCheck doc (#135199)

2024-09-06 08:18:38 +00:00

linear.py

…

load_torchscript_model.py

Flip default on weights_only (#137602)

2024-11-04 18:30:29 +00:00

minioptest_failures_dict.json

…

mkl_verbose.py

…

mkldnn_verbose.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

pytest_shard_custom.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

run_doctests.sh

…

run_test.py

[BE] Remove Model Dump utility (#141540)

2024-11-27 22:52:55 +00:00

simulate_nccl_errors.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

slow_tests.json

Update slow tests (#139051)

2024-11-04 11:49:06 +00:00

test_ao_sparsity.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_autocast.py

[MPS] Add support for bf16 autocast (#139390)

2024-11-20 19:52:28 +00:00

test_autograd_fallback.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_autograd.py

Run only listed tests on s390x (#140265)

2024-11-20 22:53:09 +00:00

test_autoload.py

[RFC] Add support for device extension autoloading (#127074)

2024-07-09 06:14:13 +00:00

test_binary_ufuncs.py

skip complex logaddexp tests in 3.12+ (#140731)

2024-11-21 01:08:07 +00:00

test_bundled_images.py

Fix lint errors in fbcode (#135614)

2024-09-13 02:04:34 +00:00

test_bundled_inputs.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_ci_sanity_check_fail.py

…

test_comparison_utils.py

[export] Add device and dtype fields to assert_tensor_metadata (#141071)

2024-11-22 20:54:55 +00:00

test_compile_benchmark_util.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_complex.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_content_store.py

…

test_cpp_api_parity.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_cpp_extensions_aot.py

remove skips due to https://github.com/pytorch/torchdynamo/issues/1991 (#138133)

2024-10-17 17:42:46 +00:00

test_cpp_extensions_jit.py

Avoid file encoding issues when loading cpp extensions (#138565)

2024-10-28 14:06:34 +00:00

test_cpp_extensions_mtia_backend.py

Unify cpp_extension build directory removal (#136059)

2024-10-03 06:22:11 +00:00

test_cpp_extensions_open_device_registration.py

Support dlpack for privateuse1 (#135331)

2024-11-13 13:13:14 +00:00

test_cpp_extensions_stream_and_event.py

Unify cpp_extension build directory removal (#136059)

2024-10-03 06:22:11 +00:00

test_cuda_expandable_segments.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_cuda_multigpu.py

Allow torch.cuda.memory.mem_get_info to take a device str argument with an unspecified device index. (#132616)

2024-08-06 13:19:46 +00:00

test_cuda_nvml_based_avail.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_cuda_primary_ctx.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_cuda_sanitizer.py

[BE]: Add better optional typing (#138426)

2024-10-27 14:19:00 +00:00

test_cuda_trace.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_cuda.py

[CUDA][64-bit indexing] Support 64-bit indexing in distribution_elementwise_grid_stride_kernel (#141613)

2024-11-30 06:55:02 +00:00

test_custom_ops.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_dataloader.py

[BE][Ez]: Update ruff to 0.7.4 (#140806)

2024-11-15 17:04:32 +00:00

test_datapipe.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_decomp.py

Added aten.bernoulli.p and aten.bernoulli.default decompositions (#139141)

2024-11-20 19:52:57 +00:00

test_deploy.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_determination.py

[Caffe2] [2/N] Remove Caffe2 from tests (#128911)

2024-06-19 00:05:50 +00:00

test_dispatch.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_dlpack.py

Use DLPack for creating tensors out of custom classes, when available. (#138697)

2024-10-26 01:27:05 +00:00

test_dynamic_shapes.py

Try to simplify FloorDiv axioms implications when needed during evaluations. (#141267)

2024-11-28 15:35:35 +00:00

test_expanded_weights.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_fake_tensor.py

Allow Fakified subclass to have different device for inner and outer tensor (#141839)

2024-12-03 00:09:41 +00:00

test_file_check.py

Fix the output of FileCheck when not run and add unit tests (#135345)

2024-09-11 04:13:24 +00:00

test_flop_counter.py

FlopCounterMode: Decompose ops for inference mode (#138508)

2024-11-25 16:53:10 +00:00

test_foreach.py

pow: fix meta function output argument dtype check. (#140287)

2024-11-20 13:28:47 +00:00

test_function_schema.py

Enable UFMT on test/test_fake_tensor.py, test/test_flop_counter.py and some files (#125747)

2024-05-15 14:50:14 +00:00

test_functional_autograd_benchmark.py

Enable UFMT on test/test_fake_tensor.py, test/test_flop_counter.py and some files (#125747)

2024-05-15 14:50:14 +00:00

test_functional_optim.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_functionalization_of_rng_ops.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_functionalization.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_futures.py

Flip default value for mypy disallow_untyped_defs [1/11] (#127838)

2024-06-08 18:16:33 +00:00

test_fx_experimental.py

[fx] make split_module work with keep_original_order=True and no-op graph (#141340)

2024-11-24 06:41:30 +00:00

test_fx_passes.py

[Partitioner] Reuse partition to check whether nodes exist (#135317)

2024-09-21 23:52:02 +00:00

test_fx_reinplace_pass.py

Allow SymInt input for torch.fx reinplace pass (#133178)

2024-08-13 20:07:17 +00:00

test_fx.py

Revert "Refactor FxGraphDrawer to use HTML-like labels (#137726)"

2024-11-04 17:44:44 +00:00

test_hub.py

Enable UFMT on test/test_hub.py (#127155)

2024-05-25 18:23:24 +00:00

test_import_stats.py

…

test_indexing.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_itt.py

…

test_jit_autocast.py

Using device-agnostic autocast api (#136613)

2024-09-27 07:16:24 +00:00

test_jit_disabled.py

…

test_jit_fuser_legacy.py

…

test_jit_fuser_te.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_jit_fuser.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_jit_legacy.py

…

test_jit_llga_fuser.py

[Dynamo] Replace torch._dynamo.optimize() with torch.compile() [2/N] (#140238)

2024-11-13 05:13:39 +00:00

test_jit_profiling.py

…

test_jit_simple.py

…

test_jit_string.py

…

test_jit.py

Add support for parsing torch.Generator in JIT (#140489)

2024-11-13 23:06:57 +00:00

test_jiterator.py

…

test_kernel_launch_checks.py

…

test_legacy_vmap.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_license.py

Fix manual licensing (#128630)

2024-06-14 00:12:09 +00:00

test_linalg.py

[ROCM] Support Multi-GPU offline tuning in TunableOp (#139673)

2024-11-26 19:07:41 +00:00

test_logging.py

Enable UFMT format on test/license.py test/logging.py (#125737)

2024-05-11 01:52:35 +00:00

test_masked.py

…

test_maskedtensor.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_matmul_cuda.py

torch._scaled_mm: support dims of size 0 for tensorwise scaling (#140967)

2024-11-27 04:07:52 +00:00

test_meta.py

pow: fix meta function output argument dtype check. (#140287)

2024-11-20 13:28:47 +00:00

test_metal.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_mkl_verbose.py

…

test_mkldnn_fusion.py

improve mkldnn_linear_pointwise_binary performance for contiguous tensor with non default contiguous strides (#132019)

2024-07-30 05:02:38 +00:00

test_mkldnn_verbose.py

…

test_mkldnn.py

Add oneDNN support for Half LSTM on CPU (#132607)

2024-08-29 03:40:10 +00:00

test_mobile_optimizer.py

[BE][Easy] enable ruff rule PIE790: unnecessary pass statement (#133200)

2024-08-15 15:50:19 +00:00

test_model_exports_to_core_aten.py

Replace capture_pre_autograd_graph with export_for_training in torch tests (#135623)

2024-09-11 19:23:08 +00:00

test_module_tracker.py

Move module_tracker to logging for confused hierarchy (#134467)

2024-08-26 19:39:08 +00:00

test_modules.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_monitor.py

[pytorch][counters] Pybind for WaitCounter (#132357)

2024-08-02 16:08:10 +00:00

test_mps.py

[MPS] Convert channels_last_3d to contiguous for input tensor in nn.Conv3d (#141780)

2024-12-01 18:36:53 +00:00

test_multiprocessing_spawn.py

multiprocessing.spawn: allow a grace period when shutdown (#131278)

2024-10-07 12:37:34 +00:00

test_multiprocessing.py

Support IPC for Expandable Segments (#130890)

2024-08-05 18:48:13 +00:00

test_namedtensor.py

…

test_namedtuple_return_api.py

sdp::SDPBackend::flash_attention support PrivateUse1 (#126392)

2024-06-28 17:48:40 +00:00

test_native_functions.py

…

test_native_mha.py

[ROCm] Update to AOTriton 0.7b (#134498)

2024-09-11 20:34:01 +00:00

test_nestedtensor.py

Switch to using Python nested int (#141166)

2024-12-02 19:17:30 +00:00

test_nn.py

softshrink nan fixes (#138421)

2024-11-21 23:06:08 +00:00

test_nnapi.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_numba_integration.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_numpy_interop.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_openmp.py

[1/N] Don't skip ASAN on some tests (#138571)

2024-10-23 02:38:45 +00:00

test_ops_fwd_gradients.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_ops_gradients.py

Run only listed tests on s390x (#140265)

2024-11-20 22:53:09 +00:00

test_ops_jit.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_ops.py

Pass rounding_mode for div reference inputs through kwargs (#136308)

2024-11-29 21:28:24 +00:00

test_optim.py

[MPS] Expand fused forloop to bfloat16 (#141104)

2024-11-22 01:07:15 +00:00

test_out_dtype_op.py

…

test_overrides.py

Introduce torch.sym_add, variadic add (#138660)

2024-10-23 17:42:41 +00:00

test_package.py

Enable UFMT format on test/test_package.py test/test_per_overload_api.py (#125834)

2024-05-09 19:48:22 +00:00

test_per_overload_api.py

Enable UFMT format on test/test_package.py test/test_per_overload_api.py (#125834)

2024-05-09 19:48:22 +00:00

test_prims.py

properly register conjugate/neg fallthroughs to prim ops (#132699)

2024-08-06 17:57:04 +00:00

test_proxy_tensor.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_pruning_op.py

…

test_public_bindings.py

[BE] Remove Model Dump utility (#141540)

2024-11-27 22:52:55 +00:00

test_python_dispatch.py

[torchgen] Improve schema parsing with regex for numeric ranges (#140210)

2024-11-14 23:28:27 +00:00

test_pytree.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_quantization.py

Rename generate_numeric_debug_handle to numeric_debugger (#130590)

2024-07-15 22:42:27 +00:00

test_reductions.py

use more elements per thread for narrow dtypes (#139449)

2024-11-14 22:50:16 +00:00

test_scatter_gather_ops.py

Fix the check for can_use_expanded_index_path (#140351)

2024-11-15 05:52:23 +00:00

test_schema_check.py

[dynamo] wrap GraphModule exceptions in dynamo-wrapped tests (#126341)

2024-05-29 05:18:04 +00:00

test_segment_reductions.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_serialization.py

Fix tests in test/test_serialization that were failing if run individually (#141300)

2024-11-22 02:40:37 +00:00

test_set_default_mobile_cpu_allocator.py

…

test_shape_ops.py

Add size param check of unfold (#139965)

2024-11-09 17:12:53 +00:00

test_show_pickle.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_sort_and_select.py

Support torch.bool in torch.sort + CUDA (#139409)

2024-11-06 00:02:54 +00:00

test_sparse_csr.py

Add out_dtype kw argument to optimize_bsr_dense_addmm (#136626)

2024-10-22 09:52:25 +00:00

test_sparse_semi_structured.py

[sparse] add extra options to _cslt_spare_mm (#137427)

2024-11-27 05:32:45 +00:00

test_sparse.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_spectral_ops.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_stateless.py

Allow optional positional arguments for torch.func.functional_call (#134643)

2024-09-12 15:22:06 +00:00

test_static_runtime.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_subclass.py

Fix failures when default is flipped for weights_only (#127627)

2024-08-16 00:22:43 +00:00

test_sympy_utils.py

[dynamo] add SymNode bitwise and/or (#138777)

2024-11-22 23:36:16 +00:00

test_tensor_creation_ops.py

fix test_float_to_int_conversion_nonfinite for NumPy 2 (#138131)

2024-11-14 04:19:19 +00:00

test_tensorboard.py

Run only listed tests on s390x (#140265)

2024-11-20 22:53:09 +00:00

test_tensorexpr_pybind.py

[BE][Easy] enable ruff rule PIE790: unnecessary pass statement (#133200)

2024-08-15 15:50:19 +00:00

test_tensorexpr.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_testing.py

More flexible test parametrization with @reparametrize (#138369)

2024-10-29 22:14:38 +00:00

test_throughput_benchmark.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_torch.py

Implement deterministic scan (#140887)

2024-11-19 23:43:26 +00:00

test_transformers.py

Lint: switch oncall owner for test_transformers (#141722)

2024-11-27 21:45:43 +00:00

test_type_hints.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_type_info.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_type_promotion.py

Add type checks for Tensor.add_ (#135864)

2024-09-19 03:09:36 +00:00

test_typing.py

[BE][Easy][6/19] enforce style for empty lines in import segments in test/ (#129757)

2024-07-17 06:42:37 +00:00

test_unary_ufuncs.py

Implement nonzero for large inputs (#141592)

2024-11-27 10:19:53 +00:00

test_utils_config_module.py

config: Throw if justknobs value is not a boolean (#139488)

2024-11-20 23:52:17 +00:00

test_utils.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_view_ops.py

Replace clone.detach with detach.clone (#140264)

2024-11-13 07:01:02 +00:00

test_vulkan.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_weak.py

[BE] Format uncategorized Python files with ruff format (#132576)

2024-08-04 17:13:31 +00:00

test_xnnpack_integration.py

Add None return type to init -- tests (#132352)

2024-08-01 15:44:51 +00:00

test_xpu.py

Use default context on Windows for Intel GPU (#138049)

2024-11-28 02:49:46 +00:00