pytorch

mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00

Files

Alex Denisov 539286a67b Inductor annotations (#130429 )

Add NVTX annotations around training phases and buffer computations

RFC/discussion: https://dev-discuss.pytorch.org/t/rfc-performance-profiling-at-scale-with-details-nvtx-annotations/2224

<img width="2160" alt="Screenshot 2024-07-10 at 11 48 04" src="https://github.com/pytorch/pytorch/assets/1175576/9ade139c-d393-473f-9b68-6c25da367dc4">

Pull Request resolved: https://github.com/pytorch/pytorch/pull/130429
Approved by: https://github.com/aorenste, https://github.com/eellison, https://github.com/albanD

Co-authored-by: Cedric GESTES <cedric.gestes@flex.ai>

2024-12-10 08:53:39 +00:00

_awaits

Remove unused imported names in python files (#134438 )

2024-08-27 20:44:04 +00:00

Inductor annotations (#130429 )

2024-12-10 08:53:39 +00:00

_C_flatbuffer

Flip default value for mypy disallow_untyped_defs [1/11] (#127838 )

2024-06-08 18:16:33 +00:00

_custom_op

Tighten torch.library.infer_schema input types (#130705 )

2024-07-29 16:01:19 +00:00

_decomp

[aotd] capture rrelu_with_noise noise mutation in compile (#141867 )

2024-12-04 12:18:58 +00:00

_dispatch

[BE][Easy][15/19] enforce style for empty lines in import segments in torch/_d*/ (#129767 )

2024-07-31 21:18:11 +00:00

_dynamo

misc. fixes to unflatten (#142141 )

2024-12-10 03:45:13 +00:00

_export

[AOTI XPU] Support AOT Inductor for Intel GPU. (#140269 )

2024-12-10 05:05:08 +00:00

_functorch

Move knapsack algorithms into separate filing (#141451 ) (#141614 )

2024-12-07 03:21:52 +00:00

_higher_order_ops

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

_inductor

Inductor annotations (#130429 )

2024-12-10 08:53:39 +00:00

_lazy

Remove unused imported names in python files (#134438 )

2024-08-27 20:44:04 +00:00

_library

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

_logging

[BE]: Apply PERF401 autofixes from ruff (#140980 )

2024-11-20 17:52:07 +00:00

_numpy

[test/torch_np] Fix usages of deprecated NumPy 2.0 APIs in numpy_tests (#131909 )

2024-08-05 16:21:08 +00:00

_prims

[BE]: Apply PERF401 autofixes from ruff (#140980 )

2024-11-20 17:52:07 +00:00

_prims_common

Remove an unused variable from _prims_common/wrappers.py (#138480 )

2024-12-10 00:12:53 +00:00

_refs

[BE]: Update mypy to 1.13.0 (#140808 )

2024-12-03 02:50:10 +00:00

_strobelight

Increase default COMPILE_STROBELIGHT_MAX_STACK_LENGTH to 500 (#138006 )

2024-10-17 07:31:32 +00:00

_subclasses

MetaTensorDesc changes for reconstructing proper FakeTensors (#141926 )

2024-12-05 14:21:57 +00:00

_vendor

…

accelerator

Introduce a device-agnostic runtime API design (#132204 )

2024-10-27 10:37:09 +00:00

amp

[MPS] Add support for bf16 autocast (#139390 )

2024-11-20 19:52:28 +00:00

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

autograd

Missing space in torch.autograd.Function deprecation warning (#141562 )

2024-11-27 01:31:26 +00:00

backends

Revert "[sparse] add search for optimal alg_id to torch.compile (#137427 )"

2024-10-24 17:27:06 +00:00

compiler

Introduce remote cache key prefix to break cache (#142148 )

2024-12-10 00:35:50 +00:00

contrib

Remove unused Python variables in torch/[b-z]* (#136963 )

2024-10-19 16:45:22 +00:00

cpu

[Inductor][CPP] Add oneDNN BRGEMM config for Half cpp gemm template (#136255 )

2024-11-05 05:33:29 +00:00

csrc

Inductor annotations (#130429 )

2024-12-10 08:53:39 +00:00

cuda

Inductor annotations (#130429 )

2024-12-10 08:53:39 +00:00

distributed

[DeviceMesh] Call no_dispatch before doing tensor slicing in DeviceMesh (#142287 )

2024-12-10 06:33:01 +00:00

distributions

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

export

misc. fixes to unflatten (#142141 )

2024-12-10 03:45:13 +00:00

fft

…

func

…

futures

Flip default value for mypy disallow_untyped_defs [7/11] (#127844 )

2024-06-08 18:49:45 +00:00

Enhance "from_node" node meta to track source recursively (#142066 )

2024-12-09 23:39:15 +00:00

jit

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

legacy

…

lib

Add and use thread-safe strerror (#140472 )

2024-11-19 04:24:17 +00:00

linalg

fix linalg.SVD docs typo: wrong V* shape in reduced SVD (#142037 )

2024-12-04 09:18:33 +00:00

masked

Correctly specify size of sparse_csr tensors in maskedtensor binary ops (#134335 )

2024-12-03 02:55:57 +00:00

monitor

[pytorch][counters] Pybind for WaitCounter (#132357 )

2024-08-02 16:08:10 +00:00

mps

[BE][Easy][17/19] enforce style for empty lines in import segments in torch/[a-c]*/ and torch/[e-n]*/ (#129769 )

2024-08-04 10:24:09 +00:00

mtia

Refactor "torch.mtia.memory_stats" API (#141723 )

2024-12-09 19:19:19 +00:00

multiprocessing

Remove unused Python variables in torch/[b-z]* (#136963 )

2024-10-19 16:45:22 +00:00

nested

[aotd] non-contiguous NestedTensor mutation in compile (#139630 )

2024-12-06 12:18:46 +00:00

[DataParallel] Skip for MPS device (#142448 )

2024-12-10 02:49:23 +00:00

onnx

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

optim

Remove some unused type ignores (round 1) (#142325 )

2024-12-09 18:23:46 +00:00

package

[torch.package, 3.13] fixes to torch.package for 3.13 (#141409 )

2024-12-05 00:23:47 +00:00

profiler

Add skip_first_wait to profiler.schedule (V2) (#141512 )

2024-11-26 18:10:54 +00:00

quantization

Remove unused Python variables in torch/[b-z]* (#136963 )

2024-10-19 16:45:22 +00:00

signal

Fix docstring for torch.signal.windows.nuttall (#134512 )

2024-08-26 22:51:43 +00:00

sparse

[sparse] add extra options to _cslt_spare_mm (#137427 )

2024-11-27 05:32:45 +00:00

special

…

testing

Add pytest support for unittest.subTests to CI env (#142238 )

2024-12-09 21:48:20 +00:00

utils

Inductor annotations (#130429 )

2024-12-10 08:53:39 +00:00

xpu

Support torch.xpu.mem_get_info API (#141230 )

2024-12-05 08:17:25 +00:00

__config__.py

Flip default value for mypy disallow_untyped_defs [1/11] (#127838 )

2024-06-08 18:16:33 +00:00

__future__.py

…

__init__.py

Transform unbacked int expressions into a fresh unbacked int. (#141917 )

2024-12-05 16:53:44 +00:00

_appdirs.py

[BE][Easy][14/19] enforce style for empty lines in import segments in torch/_[a-c]*/ and torch/_[e-h]*/ and torch/_[j-z]*/ (#129765 )

2024-07-31 10:42:50 +00:00

_classes.py

Add None return type to init (#132335 )

2024-08-01 15:26:45 +00:00

_compile.py

[BE] Format uncategorized Python files with ruff format (#132576 )

2024-08-04 17:13:31 +00:00

_custom_ops.py

[BE][Easy][14/19] enforce style for empty lines in import segments in torch/_[a-c]*/ and torch/_[e-h]*/ and torch/_[j-z]*/ (#129765 )

2024-07-31 10:42:50 +00:00

_deploy.py

Remove unused imported names in python files (#134438 )

2024-08-27 20:44:04 +00:00

_environment.py

Improve is_fbcode functionality (#136871 )

2024-09-27 21:19:01 +00:00

_guards.py

Add tensor overlapping guards. (#139555 )

2024-12-05 14:43:58 +00:00

_jit_internal.py

[BE] Format uncategorized Python files with ruff format (#132576 )

2024-08-04 17:13:31 +00:00

_linalg_utils.py

[BE] Format uncategorized Python files with ruff format (#132576 )

2024-08-04 17:13:31 +00:00

_lobpcg.py

[BE][Easy] enable ruff rule PIE790: unnecessary pass statement (#133200 )

2024-08-15 15:50:19 +00:00

_lowrank.py

[BE] Format uncategorized Python files with ruff format (#132576 )

2024-08-04 17:13:31 +00:00

_meta_registrations.py

[Quant][Inductor][X86] add fusion pass for linear_dynamic_fp16 with relu (#141556 )

2024-12-09 05:05:11 +00:00

_namedtensor_internals.py

[BE][Easy][14/19] enforce style for empty lines in import segments in torch/_[a-c]*/ and torch/_[e-h]*/ and torch/_[j-z]*/ (#129765 )

2024-07-31 10:42:50 +00:00

_ops.py

remove redundant a (#139046 )

2024-10-28 17:47:24 +00:00

_python_dispatcher.py

Add None return type to init (#132335 )

2024-08-01 15:26:45 +00:00

_size_docs.py

Flip default value for mypy disallow_untyped_defs [3/11] (#127840 )

2024-06-08 18:28:01 +00:00

_sources.py

Flip default value for mypy disallow_untyped_defs [3/11] (#127840 )

2024-06-08 18:28:01 +00:00

_storage_docs.py

[BE] Format uncategorized Python files with ruff format (#132576 )

2024-08-04 17:13:31 +00:00

_streambase.py

Use torch.Stream&torch.Event for Dynamo capature (#134850 )

2024-10-02 14:15:33 +00:00

_tensor_docs.py

Revert "Add deterministic path for CUDA cumsum (#136224 )"

2024-09-27 12:54:47 +00:00

_tensor_str.py

Speed up half tensors printing (#141927 )

2024-12-03 07:01:49 +00:00

_tensor.py

[dim_order] raised runtime error when tensor has ambiguous dim order (#141632 )

2024-12-08 23:16:57 +00:00

_thread_safe_fork.py

[inductor] parallel compile: add import of thread_safe_fork for internal (#137155 )

2024-10-03 17:37:21 +00:00

_torch_docs.py

Update documentation for torch.mean() to note behavior with empty tensors (#142039 )

2024-12-05 17:21:53 +00:00

_utils_internal.py

Change export IR to non-functional pre-dispatch IR (#139511 )

2024-11-20 21:47:55 +00:00

_utils.py

Deprecate torch._utils.is_compiling() (#127690 )

2024-12-08 22:55:36 +00:00

_VF.py

Clean up RemoteCache classes (#134032 )

2024-08-31 20:18:59 +00:00

_vmap_internals.py

[BE] enable UFMT for torch/nn/*.py (#128593 )

2024-06-23 16:05:13 +00:00

_weights_only_unpickler.py

Allow user to manually pass module.name associated with global in {add}_safe_global (#142153 )

2024-12-06 18:56:39 +00:00

abi-check.cpp

…

CMakeLists.txt

Revert "export AOTI_TORCH_EXPORT on Windows. (#140030 )"

2024-12-09 17:04:20 +00:00

custom_class_detail.h

Remove some pre-cpp17 stuff (#138410 )

2024-10-23 00:38:03 +00:00

custom_class.h

Remove some pre-cpp17 stuff (#138410 )

2024-10-23 00:38:03 +00:00

extension.h

…

functional.py

Clarify opt-einsum usage, fix #127109 (#137596 )

2024-10-09 20:31:24 +00:00

hub.py

Remove unused Python variables in torch/[b-z]* (#136963 )

2024-10-19 16:45:22 +00:00

library.h

[1/N] Enable cppcoreguidelines-special-member-functions (#137405 )

2024-10-23 00:16:53 +00:00

library.py

Improve torch.library.opcheck and register_autograd docs (#141883 )

2024-12-03 16:28:56 +00:00

overrides.py

[dim_order] raised runtime error when tensor has ambiguous dim order (#141632 )

2024-12-08 23:16:57 +00:00

py.typed

…

quasirandom.py

[BE] Format uncategorized Python files with ruff format (#132576 )

2024-08-04 17:13:31 +00:00

random.py

[Torch] Support meta device in random.fork_rng (#137715 )

2024-10-16 18:00:39 +00:00

README.txt

…

return_types.py

[BE] enable UFMT for top-level files torch/*.py (#127707 )

2024-06-12 20:15:05 +00:00

script.h

…

serialization.py

Allow user to manually pass module.name associated with global in {add}_safe_global (#142153 )

2024-12-06 18:56:39 +00:00

storage.py

Fix .to(cpu) for Storage (#138011 )

2024-10-23 01:31:48 +00:00

torch_version.py

Add mypy typing to torch_version.py (#131447 )

2024-07-23 17:31:07 +00:00

types.py

[BE] better type annotation for torch.types (#129559 )

2024-09-02 15:35:32 +00:00

version.py.tpl

…

README.txt

Note [TH abstraction violation]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

TH/THC provide some hpp headers, which are proper C++ headers rather than
C headers.  These headers serve double duty as *internal implementation
detail* headers, whose contents should largely not be used by external
clients.

Ideally, we would not install these headers at all; instead, you should
use public functions (in headers like `THTensor.h`, NOT `THTensor.hpp`)
to manipulate these structs.  However, there are a few places
in torch/csrc where we violate this abstraction.  They are marked with
a pointer to this note.  Each of those sites will have to be refactored
when we refactor the guts of THTensor and related structures.