frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-21 05:34:18 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
f2e6b0837ab977a6924cf060898c6c4a675cb25f
pytorch/docs/source
History
Driss Guessous 5a81508bb6 Add NestedTensor ops: logical_not, logical_not_, masked_fill (#97934) 
# Summary
<!--
copilot:summary
-->
### <samp>🤖 Generated by Copilot at 7954302</samp>

This pull request adds support for `logical_not` and `masked_fill` operations on nested tensors, which are tensors that can have tensors as elements. It modifies the `native_functions.yaml` file to dispatch these operations to the nested tensor backend, implements the logic for these operations in `NestedTensorBinaryOps.cpp` and `NestedTensorUnaryOps.cpp`, adds documentation in `nested.rst`, and adds tests in `test_nestedtensor.py`.

## Description
<!--
copilot:walkthrough
-->
### <samp>🤖 Generated by Copilot at 7954302</samp>

*  Implement `logical_not` operation on nested tensors ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-2f3dbd85efb9b5172f2264eedd3be47dd765e6ab7cc8bf3ade5e62c28ae35991R1164), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-2f3dbd85efb9b5172f2264eedd3be47dd765e6ab7cc8bf3ade5e62c28ae35991R1172), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-f7c94671810b3ce652f9ad5458518cb7bbd67e8bf7e84e0a2fba641d878ba7c5R45-R56), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-c8b131d009badb3f92031b2aaa6e7f93a793f13caee278ea78e1c57d78c0399eR203), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-6eef496a8ec635930b6e52507358e069c80021f3535b8737d39e14ffc38950c0L854-R867))
  - Add `NestedTensor_logical_not` and `NestedTensor_logical_not_` functions to `native_functions.yaml` for CPU and CUDA dispatch ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-2f3dbd85efb9b5172f2264eedd3be47dd765e6ab7cc8bf3ade5e62c28ae35991R1164), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-2f3dbd85efb9b5172f2264eedd3be47dd765e6ab7cc8bf3ade5e62c28ae35991R1172))
  - Define `NestedTensor_logical_not` and `NestedTensor_logical_not_` functions in `NestedTensorUnaryOps.cpp` using `map_nt` and `get_buffer` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-f7c94671810b3ce652f9ad5458518cb7bbd67e8bf7e84e0a2fba641d878ba7c5R45-R56))
  - Document `torch.logical_not` function for nested tensors in `nested.rst` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-c8b131d009badb3f92031b2aaa6e7f93a793f13caee278ea78e1c57d78c0399eR203))
  - Add subtest for `logical_not` function in `test_activations` method in `TestNestedTensorDeviceType` class in `test_nestedtensor.py` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-6eef496a8ec635930b6e52507358e069c80021f3535b8737d39e14ffc38950c0L854-R867))
* Implement `masked_fill` operation on nested tensors ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-2f3dbd85efb9b5172f2264eedd3be47dd765e6ab7cc8bf3ade5e62c28ae35991R7439), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-f847e41e3d373230df0b25574e993ec0e6b699bf16796b3df9ae9fb518048e25L210-R224), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-c8b131d009badb3f92031b2aaa6e7f93a793f13caee278ea78e1c57d78c0399eR197), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-6eef496a8ec635930b6e52507358e069c80021f3535b8737d39e14ffc38950c0R677-R688), [link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-6eef496a8ec635930b6e52507358e069c80021f3535b8737d39e14ffc38950c0R2515-R2528))
  - Add `NestedTensor_masked_fill` function to `native_functions.yaml` for CPU and CUDA dispatch ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-2f3dbd85efb9b5172f2264eedd3be47dd765e6ab7cc8bf3ade5e62c28ae35991R7439))
  - Define `NestedTensor_masked_fill` function in `NestedTensorBinaryOps.cpp` using `NestedTensor_elementwise_Tensor` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-f847e41e3d373230df0b25574e993ec0e6b699bf16796b3df9ae9fb518048e25L210-R224))
  - Document `torch.Tensor.masked_fill` function for nested tensors in `nested.rst` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-c8b131d009badb3f92031b2aaa6e7f93a793f13caee278ea78e1c57d78c0399eR197))
  - Add test case for `masked_fill` function in `TestNestedTensorDeviceType` class in `test_nestedtensor.py` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-6eef496a8ec635930b6e52507358e069c80021f3535b8737d39e14ffc38950c0R677-R688))
  - Add test case for backward pass of `masked_fill` function in `TestNestedTensorAutograd` class in `test_nestedtensor.py` ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-6eef496a8ec635930b6e52507358e069c80021f3535b8737d39e14ffc38950c0R2515-R2528))
* Improve error message for unsupported element-wise binary operations on nested dense tensors ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-f847e41e3d373230df0b25574e993ec0e6b699bf16796b3df9ae9fb518048e25L142-R150))
  - Modify `NestedTensor_elementwise_Tensor` function in `NestedTensorBinaryOps.cpp` to include operation name in error message ([link](https://github.com/pytorch/pytorch/pull/97934/files?diff=unified&w=0#diff-f847e41e3d373230df0b25574e993ec0e6b699bf16796b3df9ae9fb518048e25L142-R150))

Pull Request resolved: https://github.com/pytorch/pytorch/pull/97934
Approved by: https://github.com/cpuhrsch
2023-03-30 08:14:39 +00:00
..
_static
Move Dynamo docs back to core (#89769)
2022-11-29 04:38:53 +00:00
_templates
Add a private API banner (#93996)
2023-02-03 21:40:15 +00:00
community
[PT-D] Update CODEOWNERS, merge_rules, and Persons-of-Interest for to… (#96321)
2023-03-13 17:38:43 +00:00
compile
Fixed broken link to troubleshooting.html docs page (#97330)
2023-03-22 16:40:21 +00:00
elastic
[BE] Prefer dash over underscore in command-line options (#94505)
2023-02-09 20:16:49 +00:00
notes
Fix typo under docs directory (#97202)
2023-03-21 01:24:10 +00:00
rpc
Support Union in TorchScript (#64234)
2021-09-03 06:12:24 -07:00
scripts
Rename Canonical Aten IR to Core Aten IR (#92904)
2023-01-25 05:12:23 +00:00
_dynamo.rst
Add torch._dynamo to docs (#89510)
2022-11-23 16:33:13 +00:00
amp.rst
Remove deprecated torch.matrix_rank (#70981)
2022-09-22 17:40:46 +00:00
autograd.rst
Expose autograd.graph.Node as an abstract base class (#91475)
2023-01-18 00:20:13 +00:00
backends.rst
[CUDA][cuFFT] Minor fix for cuFFT plan cache docs (#96373)
2023-03-14 00:28:14 +00:00
benchmark_utils.rst
Cleanup all module references in doc (#73983)
2022-03-10 22:26:29 +00:00
bottleneck.rst
add itt unit test and docstrings (#84848)
2022-09-28 01:39:58 +00:00
checkpoint.rst
Stashing checkpointing RNG states based on devices of arg tensors (#14518)
2018-12-11 09:48:45 -08:00
complex_numbers.rst
Add a note on CUDA 11.6 (#80363)
2022-06-27 21:34:24 +00:00
conf.py
Update copyright (#95652)
2023-02-27 23:15:55 +00:00
config_mod.rst
rename config module file to work with gh pages better
2022-03-10 20:41:44 +00:00
cpp_extension.rst
Check clang++/g++ version when compiling CUDA extensions (#63230)
2022-02-24 08:32:32 +00:00
cpp_index.rst
Add C++ Landing Page (#38450)
2020-05-14 16:02:01 -07:00
cuda._sanitizer.rst
Fix typos under docs directory (#88033)
2022-10-31 19:31:56 +00:00
cuda.rst
Add more GPU metric instrumentation (#91717)
2023-02-24 00:38:03 +00:00
cudnn_persistent_rnn.rst
Remove orphan from cuDNN persistent note (#65160)
2021-09-21 11:09:47 -07:00
cudnn_rnn_determinism.rst
Forbid trailing whitespace (#53406)
2021-03-05 17:22:55 -08:00
data.rst
[DataLoader] Removing DataLoader2 related code (#88848)
2022-11-11 22:27:01 +00:00
ddp_comm_hooks.rst
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
deploy.rst
Delete torch::deploy from pytorch core (#85953)
2022-10-06 07:20:16 +00:00
distributed.algorithms.join.rst
Add tutorial link (#62785)
2021-08-05 17:28:02 -07:00
distributed.checkpoint.rst
[DCP] Add DCP FSDP sharded_state_dict checkpoint example to DCP .rst file (#95517)
2023-03-03 18:09:10 +00:00
distributed.elastic.rst
[1/n][torch/elastic] Move torchelastic docs *.rst (#148)
2021-05-04 00:57:56 -07:00
distributed.optim.rst
[distributed][docs] Delete distributed optimimzer section from RPC and add reference to namespace docs page (#68068)
2021-11-09 15:01:54 -08:00
distributed.rst
[Doc][Distributed] Add missing functions to distributed.rst (#89905)
2022-12-04 07:22:54 +00:00
distributed.tensor.parallel.rst
[PT-D][Sequence Parallelism] Enable DTensor based Naive sequence parallelism (#94369)
2023-02-16 21:21:00 +00:00
distributions.rst
[Reinstate] Wishart distribution (#70377)
2021-12-30 11:41:46 -08:00
dlpack.rst
Lint trailing newlines (#54737)
2021-03-30 13:09:52 -07:00
docutils.conf
Revert "Revert D21337640: [pytorch][PR] Split up documentation into subpages and clean up some warnings" (#37778)
2020-05-04 14:32:35 -07:00
fft.rst
Cleanup all module references in doc (#73983)
2022-03-10 22:26:29 +00:00
fsdp.rst
[FSDP()][3/N] Refactor public APIs (#87917)
2022-10-31 16:45:21 +00:00
func.api.rst
[functorch] linearize (#94173)
2023-02-09 15:45:08 +00:00
func.batch_norm.rst
Fix typo under docs directory (#97202)
2023-03-21 01:24:10 +00:00
func.migrating.rst
[torch.func] Add migration guide from functorch (#91811)
2023-01-17 22:14:42 +00:00
func.rst
Fix typo under docs directory (#92762)
2023-01-23 18:07:22 +00:00
func.ux_limitations.rst
[torch.func] Add docs (#91319)
2022-12-30 02:51:18 +00:00
func.whirlwind_tour.rst
[torch.func] Add docs (#91319)
2022-12-30 02:51:18 +00:00
futures.rst
Update docs to mention CUDA support for Future (#50048)
2021-05-11 08:26:33 -07:00
fx.rst
prepare removal of deprecated functionality in torch.testing (#87969)
2022-11-02 14:04:48 +00:00
hub.rst
Fix typo under docs directory (#92762)
2023-01-23 18:07:22 +00:00
index.rst
Rework torch.compile docs (#96706)
2023-03-15 04:41:13 +00:00
ir.rst
Rename Canonical Aten IR to Core Aten IR (#92904)
2023-01-25 05:12:23 +00:00
jit_builtin_functions.rst
Lint trailing newlines (#54737)
2021-03-30 13:09:52 -07:00
jit_language_reference_v2.rst
Fix typo under docs directory (#97202)
2023-03-21 01:24:10 +00:00
jit_language_reference.rst
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
jit_python_reference.rst
[JIT] improve documentation (#57991)
2021-05-19 11:47:32 -07:00
jit_unsupported.rst
(Re-open) Adds cudaMallocAsync as an alternative backend for the CUDA allocator (#82682)
2022-10-12 03:44:21 +00:00
jit_utils.rst
Create __init__.py (#78629)
2022-06-03 18:14:21 +00:00
jit.rst
[BE] [1/3] Rewrite super() calls in caffe2 and benchmarks (#94587)
2023-02-11 18:19:48 +00:00
library.rst
Add docs for Python Registration
2022-06-13 23:21:23 +00:00
linalg.rst
Add a note on the stability of linalg functions. (#88313)
2022-11-07 22:44:23 +00:00
masked.rst
Fix link in docs (#94686)
2023-02-13 20:42:24 +00:00
math-quantizer-equation.png
adding quantization.rst file for quantization feature (#27559)
2019-10-09 16:45:09 -07:00
mobile_optimizer.rst
[Reland] Clean Up MobileOptimizerType Rewrite Flags Public API and Documentation (#92081)
2023-01-14 17:06:00 +00:00
model_zoo.rst
add/move a few apis in torch.hub (#18758)
2019-04-10 23:10:39 -07:00
monitor.rst
torch/monitor: merge Interval and FixedCount stats (#72009)
2022-01-30 23:21:59 +00:00
mps.rst
[MPS] Enable Memory Leak Detection for test_mps.py (#94646)
2023-02-13 17:56:24 +00:00
multiprocessing.rst
Forbid trailing whitespace (#53406)
2021-03-05 17:22:55 -08:00
name_inference.rst
Softmax added to tensor, torch and docs (#91292)
2022-12-28 15:06:24 +00:00
named_tensor.rst
Add torch.unflatten and improve its docs (#81399)
2022-07-29 15:02:42 +00:00
nested.rst
Add NestedTensor ops: logical_not, logical_not_, masked_fill (#97934)
2023-03-30 08:14:39 +00:00
nn.functional.rst
[SDPA] update type hint for scaled_dot_product_attention and documentation (#94008)
2023-02-10 18:02:43 +00:00
nn.init.rst
update nn.init doc to reflect the no_grad (#80882)
2022-07-07 17:19:29 +00:00
nn.rst
[easy] Expose documentation for a few global nn.Module hooks (#97185)
2023-03-21 20:09:29 +00:00
onnx_diagnostics.rst
[ONNX] Document ONNX diagnostics (#88371)
2022-11-16 19:21:46 +00:00
onnx_supported_aten_ops.rst
[ONNX] Update ONNX documentation to include unsupported operators (#84496)
2022-09-16 23:48:37 +00:00
onnx.rst
[ONNX] Documentation for torch.onnx.find_mismatch (#90728)
2023-01-11 23:58:57 +00:00
optim.rst
[optim] Add general documentation on our algorithm defaults (#95391)
2023-02-24 21:35:30 +00:00
package.rst
Fix typos in torch.package documentation (#82994)
2022-08-08 20:19:17 +00:00
pipeline.rst
Minor changes in documentation (#68557)
2021-11-18 17:57:16 -08:00
profiler.rst
Fix ITT unit-tests if PyTorch is compiled with USE_ITT=OFF (#86199)
2022-10-04 21:57:05 +00:00
quantization-accuracy-debugging.rst
Fix typo under docs directory (#87583)
2022-10-24 23:52:44 +00:00
quantization-backend-configuration.rst
update quantization doc: add x86 backend as default backend of server inference (#86794)
2022-12-02 02:10:25 +00:00
quantization-support.rst
AO migration: migrate .rst files to new locations (#94211)
2023-02-07 02:32:23 +00:00
quantization.rst
AO migration: migrate .rst files to new locations (#94211)
2023-02-07 02:32:23 +00:00
random.rst
Remove duplicated entries in random.rst (#39725)
2020-06-10 16:51:15 -07:00
rpc.rst
Fix typo under docs directory and RELEASE.md (#85896)
2022-09-29 21:41:59 +00:00
signal.rst
Nuttall window (#90103)
2022-12-16 09:05:53 +00:00
sparse.rst
Minor error in docs regarding execution time (#93258)
2023-01-31 23:32:42 +00:00
special.rst
[primTorch] special: j0, j1, spherical_j0 (#86049)
2022-10-04 18:21:46 +00:00
storage.rst
Deprecate TypedStorage, its derived classes, and all of their public methods (#85303)
2022-11-08 18:11:01 +00:00
tensor_attributes.rst
Add a warning about performance cost of set_default_device (#92703)
2023-01-21 02:23:13 +00:00
tensor_view.rst
Correcting a minor typo: "Users should pay" instead of "Users should be pay" (#72500)
2022-02-08 23:08:25 +00:00
tensorboard.rst
Cleanup all module references in doc (#73983)
2022-03-10 22:26:29 +00:00
tensors.rst
Remove deprecated torch.symeig (#70988)
2023-01-31 11:59:11 +00:00
testing.rst
document torch.testing.assert_allclose (#89526)
2022-12-01 11:22:50 +00:00
torch.ao.ns._numeric_suite_fx.rst
Quantization docs: add pages for Numeric Suite (Eager and FX) (#66380)
2021-10-11 18:47:58 -07:00
torch.ao.ns._numeric_suite.rst
Quantization docs: add pages for Numeric Suite (Eager and FX) (#66380)
2021-10-11 18:47:58 -07:00
torch.overrides.rst
Revert "Revert "Implement sym_sizes to create proper IR for sym ints representing tensor sizes (#76836)""
2022-05-18 18:40:57 +00:00
torch.rst
Rework torch.compile docs (#96706)
2023-03-15 04:41:13 +00:00
type_info.rst
ENH: Convert finfo.tiny to finfo.smallest_normal (#76292)
2022-05-20 00:59:48 +00:00