From 33070aece62c7b07731c8f87c382abdc30523c53 Mon Sep 17 00:00:00 2001 From: Manuel Date: Wed, 3 Jul 2024 19:25:40 +0200 Subject: [PATCH] Updated Autograd Basics (markdown) --- Autograd-Basics.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/Autograd-Basics.md b/Autograd-Basics.md index d20bee5..c4426a4 100644 --- a/Autograd-Basics.md +++ b/Autograd-Basics.md @@ -114,3 +114,6 @@ python test/ -k attn - tests requiring forward AD to be implemented _when you turn your op from CompositeImplicit to CompositeExplicit_, since the forward AD will no longer be derived for you. - tests requiring decompositions will fail with messages like `aten.attn.default - couldn't find symbolic meta function/decomposition` _when you turn your op from CompositeImplicit to CompositeExplicit_, since those won't be derived for you anymore either. - You can skip `attn` in the fake_autocast_device tests for CPU _when you turn your op from CompositeImplicit to CompositeExplicit_. + +## Next +Unit 3: Autograd - [Autograd Lab](https://github.com/pytorch/pytorch/wiki/Autograd-Onboarding-Lab) \ No newline at end of file