Pian Pawakapan a678eaf1ad check fake/real mismatches during real tensor prop (#137747) ...

Summary:
While testing exportability for PT2 Inference models, we found various cases of invalid op inputs during tracing, for example errors like: `a and b must have same reduction dim`, `expected scalar type Long but found Int`, etc. Looking more closely, these happened to due the same few meta kernels & eager kernels producing mismatched outputs upstream (e.g. different output tensor dtype, int output).

Adding checks to catch mismatched outputs in real tensor prop upstream, so errors are raised at the mismatched op, instead of the downstream ops taking them as inputs. Relies a lot on utils from [CrossRefFakeMode](929797dedb/torch/_subclasses/fake_utils.py (L78))

Follow ups: could add more checks, and maybe have a flag to only enable these for cases like draft mode, so perf doesn't suffer?

Test Plan: test_export, test_fake_tensor

Differential Revision: D64210055

Pull Request resolved: https://github.com/pytorch/pytorch/pull/137747
Approved by: https://github.com/zou3519

2024-11-04 23:39:48 +00:00

..

__init__.py

check fake/real mismatches during real tensor prop (#137747)

2024-11-04 23:39:48 +00:00

wrappers.py

Revert "Fix unbind_copy and add its decomposition (#134319)"

2024-10-29 04:54:37 +00:00