tomMoral ff94c9dee4 DOC fix momentum equation for nesterov ...

Fix https://github.com/pytorch/pytorch/issues/72395

This is a small fix in the doc for an indice in this equation:

![image](https://user-images.githubusercontent.com/3321081/166165461-140855b5-96b5-4417-85fc-2a170f95700a.png)

I think teh indice should not be `t-1` but `t`. This is coherent with [the implementation)[https://github.com/pytorch/pytorch/blob/master/torch/optim/sgd.py#L236] and with what is done for instance in [keras](https://www.tensorflow.org/api_docs/python/tf/keras/optimizers/SGD).
Pull Request resolved: https://github.com/pytorch/pytorch/pull/76639
Approved by: https://github.com/albanD

2022-05-04 20:40:21 +00:00

..

_multi_tensor

[PyTorch/d2go] fix optim _multi_tensor (#73215)

2022-02-23 10:29:48 +00:00

__init__.py

To add Rectified Adam Algorithm to Optimizers (#58968)

2021-06-23 18:27:57 -07:00

__init__.pyi

To add Rectified Adam Algorithm to Optimizers (#58968)

2021-06-23 18:27:57 -07:00

_functional.py

Optim foreach cleanup for AdamW (#70484)

2022-02-15 18:02:08 +00:00

adadelta.py

Add maximize flag to Adadelta

2022-04-08 20:32:35 +00:00

adadelta.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

adagrad.py

Adding maximize flag to Adagrad

2022-04-20 08:29:03 +00:00

adagrad.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

adam.py

Optim foreach cleanup for Adam (#70295)

2022-02-15 18:02:08 +00:00

adam.pyi

More type stubs (#18511)

2019-04-01 16:03:58 -07:00

adamax.py

Optim foreach cleanup for Adamax (#69982)

2022-02-09 16:52:13 +00:00

adamax.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

adamw.py

Optim foreach cleanup for AdamW (#70484)

2022-02-15 18:02:08 +00:00

adamw.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

asgd.py

Optim foreach cleanup for ASGD (#70231)

2022-02-09 16:52:13 +00:00

asgd.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

lbfgs.py

breakup optim, cuda documentation (#55673)

2021-04-14 12:44:00 -07:00

lbfgs.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

lr_scheduler.py

Fix CosineAnnealingLR on restart

2022-04-20 13:35:01 +00:00

lr_scheduler.pyi

update SequentialLR signature (#69817)

2021-12-16 12:58:00 -08:00

nadam.py

Optim foreach cleanup for NAdam (#70229)

2022-02-09 16:52:13 +00:00

nadam.pyi

To add Nesterov Adam Algorithm to Optimizers (#59009)

2021-06-23 08:21:43 -07:00

optimizer.py

Fix casting bug in state_step for optimizers when loading state dict

2022-04-05 01:27:18 +00:00

optimizer.pyi

fix optimizer.pyi typo 'statue'->'state' (#49388)

2020-12-15 23:41:56 -08:00

radam.py

Optim foreach cleanup for RAdam (#70230)

2022-02-09 16:52:13 +00:00

radam.pyi

To add Rectified Adam Algorithm to Optimizers (#58968)

2021-06-23 18:27:57 -07:00

rmsprop.py

Optim foreach cleanup for Rmsprop (#70482)

2022-02-15 18:02:08 +00:00

rmsprop.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

rprop.py

Docs: Add missing zero-ing step in Rprop algorithm

2022-04-11 21:57:13 +00:00

rprop.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

sgd.py

DOC fix momentum equation for nesterov

2022-05-04 20:40:21 +00:00

sgd.pyi

More type stubs (#18511)

2019-04-01 16:03:58 -07:00

sparse_adam.py

To refactor Sparse Adam algorithm for functional form (#59171)

2021-06-25 06:35:39 -07:00

sparse_adam.pyi

Add types for the remaining optimizers. (#31130)

2019-12-12 06:36:41 -08:00

swa_utils.py

Add missing import (#72840)

2022-02-15 19:43:54 +00:00

swa_utils.pyi

Forbid trailing whitespace (#53406)

2021-03-05 17:22:55 -08:00