frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00
Code Issues Packages Projects Releases Wiki Activity

[inductor] Add fallback for collectives size estimation for unbacked (#127562)

Browse Source 
Differential Revision: [D57982928](https://our.internmc.facebook.com/intern/diff/D57982928)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/127562
Approved by: https://github.com/yifuwang
This commit is contained in:
IvanKobzarev
2024-05-30 13:01:48 -07:00
committed by PyTorch MergeBot
parent f4d7cdc5e6
commit df0c69f32d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
torch/_inductor/comm_analysis.py
View File

@ -59,7 +59,7 @@ def get_collective_input_size_bytes(node: ir.IRNode) -> int:
# For ease of testing
numel = int(numel)
else:
numel = V.graph.sizevars.size_hint(numel)
numel = V.graph.sizevars.size_hint(numel, fallback=0)
sz_bytes += numel * get_dtype_size(inp.layout.dtype)
return sz_bytes