oliver 3d358a7678 Adds a maximize flag to Adam (#68164) ...

Summary:
Solves the next most important use case in https://github.com/pytorch/pytorch/issues/68052.

I have kept the style as close to that in SGD as seemed reasonable, given the slight differences in their internal implementations.

All feedback welcome!

cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse SciPioneer H-Huang

Pull Request resolved: https://github.com/pytorch/pytorch/pull/68164

Reviewed By: VitalyFedyunin

Differential Revision: D32994129

Pulled By: albanD

fbshipit-source-id: 65c57c3f3dbbd3e3e5338d51def54482503e8850

2021-12-13 05:53:53 -08:00

..

__init__.py

Implement and benchmark a torch.optim.multi_tensor.adagrad implementation (#59155)

2021-07-07 08:08:32 -07:00

__init__.pyi

Implement and benchmark a torch.optim.multi_tensor.adagrad implementation (#59155)

2021-07-07 08:08:32 -07:00

_functional.py

[Pytorch][Bootcamp] Add fixes and vanilla testing for Adagrad non-vectorized and vectorized optimizers to handle complex numbers (#66671)

2021-10-25 10:13:21 -07:00

adadelta.py

To intorduce Functional API for multi-tensor (#60735)

2021-06-25 13:09:26 -07:00

adadelta.pyi

Lint trailing newlines (#54737)

2021-03-30 13:09:52 -07:00

adagrad.py

[Pytorch][Bootcamp] Add fixes and vanilla testing for Adagrad non-vectorized and vectorized optimizers to handle complex numbers (#66671)

2021-10-25 10:13:21 -07:00

adagrad.pyi

Implement and benchmark a torch.optim.multi_tensor.adagrad implementation (#59155)

2021-07-07 08:08:32 -07:00

adam.py

Adds a maximize flag to Adam (#68164)

2021-12-13 05:53:53 -08:00

adam.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00

adamax.py

To intorduce Functional API for multi-tensor (#60735)

2021-06-25 13:09:26 -07:00

adamax.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00

adamw.py

Forbid trailing whitespace (#53406)

2021-03-05 17:22:55 -08:00

adamw.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00

asgd.py

To intorduce Functional API for multi-tensor (#60735)

2021-06-25 13:09:26 -07:00

asgd.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00

nadam.py

To add Nesterov Adam algorithm for multi-tensor optimizers API (#59165)

2021-06-27 17:00:41 -07:00

nadam.pyi

To add Nesterov Adam algorithm for multi-tensor optimizers API (#59165)

2021-06-27 17:00:41 -07:00

radam.py

To add Rectified Adam algorithm for multi-tensor optimizers API (#59161)

2021-06-27 13:01:20 -07:00

radam.pyi

To add Rectified Adam algorithm for multi-tensor optimizers API (#59161)

2021-06-27 13:01:20 -07:00

rmsprop.py

[*.py] Rename "Arguments:" to "Args:" (#49736)

2020-12-28 09:34:47 -08:00

rmsprop.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00

rprop.py

Forbid trailing whitespace (#53406)

2021-03-05 17:22:55 -08:00

rprop.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00

sgd.py

Adds a maximize flag to SGD. (#67847)

2021-11-09 00:43:07 -08:00

sgd.pyi

[RELAND] Added optimizers based on multi tensor apply (#45408)

2020-09-28 13:14:04 -07:00