frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00
Code Issues Packages Projects Releases Wiki Activity

Updated Tensor and Operator Basics (markdown)

Richard Zou
2021-06-15 12:04:53 -04:00
parent 54b4399d94
commit 88d4aff6e1
1 changed files with 35 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

36
Tensor-and-Operator-Basics.md

@ -1 +1,35 @@
Coming soon
## Scope
* Understand what an operator is in PyTorch
* Understand what a Tensor is (including stride, dtype, and layout)
* Understand what views are
* Understand how to author an operator in PyTorch
* Understand how to test operators in PyTorch
* Understand what TensorIterator is
## What is a Tensor?
A Tensor [consists of](https://github.com/pytorch/pytorch/blob/2d6fd22e241763da67e8076a8d3443d988215f32/c10/core/TensorImpl.cpp#L84-L90):
* data_ptr, a pointer to a chunk of memory
* some *sizes* metadata
* some *strides* metadata
* a storage offset
## How to author an operator
Coming soon
## TensorIterator
- Read through the colab notebook ([link](https://colab.research.google.com/drive/1vOiQjcp6eESOChCxDQEPQXw3c0yKVjbP))
- Listen to the podcast ([link](https://podcasts.apple.com/us/podcast/tensoriterator/id1566080008?i=1000523781021))
## Learn about view operations
- Read through the colab notebook ([link](https://colab.research.google.com/drive/1rJP2aw-f5Iwqwri0_Ei_OI8_esh1Nyeq?usp=sharing))
- Try out the Tensor Views lab ([link](https://colab.research.google.com/drive/1rJP2aw-f5Iwqwri0_Ei_OI8_esh1Nyeq#scrollTo=LpTEuP0JZzav&line=1&uniqifier=1))