frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fix SparseAdam consuming iterator (#86210)

Browse Source 
Fixes https://github.com/pytorch/pytorch/issues/86209
Pull Request resolved: https://github.com/pytorch/pytorch/pull/86210
Approved by: https://github.com/cpuhrsch
This commit is contained in:
Tongzhou Wang
2022-10-06 23:11:22 +00:00
committed by PyTorch MergeBot
parent f0977c4658
commit 5ed75ec1d7
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
torch/optim/sparse_adam.py
View File

@ -40,7 +40,9 @@ class SparseAdam(Optimizer):
sparse_params = []
for index, param in enumerate(params):
if isinstance(param, dict):
for d_index, d_param in enumerate(param.get("params", [])):
# given param group, convert given params to a list first before iterating
param['params'] = list(param.get("params", []))
for d_index, d_param in enumerate(param['params']):
if d_param.is_sparse:
sparse_params.append([index, d_index])
elif param.is_sparse: