zeshengzong 5eebcb991a Add scripts to generate plots of LRSchedulers (#149189) ...

Fixes #92007

## Changes

- Add script to generate plots for `lr_scheduler`
- Add plots to `lr_scheduler` docs
- Add example section if it missing in `lr_scheduler` docs

## Test Result

### LambdaLR

![image](https://github.com/user-attachments/assets/37fc0894-e2ec-48f2-a2d6-3514e51e1ea2)

### MultiplicativeLR

![image](https://github.com/user-attachments/assets/2122b3a0-a4ce-42c7-bb45-559c1fc73e0f)

### StepLR

![image](https://github.com/user-attachments/assets/47bc9d96-4b60-4586-a000-f213583bbe8f)

### MultiStepLR

![image](https://github.com/user-attachments/assets/c822b849-d5be-4b94-aa7a-0017a2c9ff15)

### ConstantLR

![image](https://github.com/user-attachments/assets/83107cdd-7b00-44a6-b09d-e8ee849b4a12)

### LinearLR

![image](https://github.com/user-attachments/assets/60190105-691a-4101-8966-5b0c396093a4)

### ExponentialLR

![image](https://github.com/user-attachments/assets/dfcbcbca-89e5-4a2f-b1bd-33e25d2405ec)

### PolynomialLR

![image](https://github.com/user-attachments/assets/7c3d4fce-c846-40a0-b62e-f3e81c7e08bd)

### CosineAnnealingLR

![image](https://github.com/user-attachments/assets/26712769-dde9-4faa-b61b-e23c51daef50)

### ChainedScheduler

![image](https://github.com/user-attachments/assets/20734a8b-e939-424f-b45a-773f86f020b1)

### SequentialLR

![image](https://github.com/user-attachments/assets/2cd3ed67-2a0a-4c42-9ad2-e0be090d3751)

### ReduceLROnPlateau

![image](https://github.com/user-attachments/assets/b77f641e-4810-450d-b2cd-8b3f134ea188)

### CyclicLR

![image](https://github.com/user-attachments/assets/29b8666f-41b3-45e4-9159-6929074e6108)

### OneCycleLR

![image](https://github.com/user-attachments/assets/d5b683ef-41e8-4ca8-9fe8-0f1e6b433866)

### CosineAnnealingWarmRestarts

![image](https://github.com/user-attachments/assets/1d45ea80-dea8-494d-a8ab-e9cfc94c55d6)

Pull Request resolved: https://github.com/pytorch/pytorch/pull/149189
Approved by: https://github.com/janeyx99

2025-04-14 09:53:38 +00:00

..

_multi_tensor

Optim package docstring fix (#129086)

2024-06-21 14:30:53 +00:00

__init__.py

[BE][optim] Make pyright recognize exported symbols (#135043)

2024-09-04 21:53:46 +00:00

_adafactor.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

_functional.py

PEP585 update - torch/nn torch/optim torch/package torch/profiler torch/serialization torch/sparse torch/xpu (#145175)

2025-01-21 16:57:27 +00:00

adadelta.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

adagrad.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

adam.py

[MPS] grad scaler (#150255)

2025-04-06 17:06:55 +00:00

adamax.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

adamw.py

PEP585 update - torch/nn torch/optim torch/package torch/profiler torch/serialization torch/sparse torch/xpu (#145175)

2025-01-21 16:57:27 +00:00

asgd.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

lbfgs.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

lr_scheduler.py

Add scripts to generate plots of LRSchedulers (#149189)

2025-04-14 09:53:38 +00:00

nadam.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

optimizer.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

radam.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

rmsprop.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

rprop.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

sgd.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

sparse_adam.py

Convert Tensor lr to 0-dim as needed for the optimizer to normally work (#145674)

2025-03-17 23:07:05 +00:00

swa_utils.py

Revert "Fix non-bitwise type annotations for Tensor operators (see #145838) (#146845)"

2025-02-18 19:01:27 +00:00