frozenleaves/pytorch
1
0
Fork 0
mirror of https://github.com/pytorch/pytorch.git synced 2025-10-20 21:14:14 +08:00
Code Issues Packages Projects Releases Wiki Activity

Simplify BFLOAT16_AVAILABLE (#163445)

Browse Source 
Simplify `BFLOAT16_AVAILABLE` by using `torch.cuda.is_bf16_supported()`  and `torch.xpu.is_bf16_supported()`. Outdated comments are also removed.

Pull Request resolved: https://github.com/pytorch/pytorch/pull/163445
Approved by: https://github.com/Skylion007, https://github.com/kwen2501
This commit is contained in:
Yuanyuan Chen
2025-09-22 07:31:43 +00:00
committed by PyTorch MergeBot
parent edafc902d7
commit 96a3afb8ec
2 changed files with 1 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
test/distributed/fsdp/test_fsdp_comm_hooks.py
View File

@ -34,11 +34,7 @@ device_type = (
acc.type if (acc := torch.accelerator.current_accelerator(True)) else "cpu"
)
# bfloat16 is only supported by CUDA 11+ or XPU
BFLOAT16_AVAILABLE = (
torch.cuda.is_available()
and (torch.version.cuda is not None or torch.version.hip is not None)
) or torch.xpu.is_available()
BFLOAT16_AVAILABLE = torch.cuda.is_bf16_supported() or torch.xpu.is_bf16_supported()
class Net(nn.Module):

1
test/distributed/test_c10d_nccl.py
View File

@ -83,7 +83,6 @@ if TEST_WITH_DEV_DBG_ASAN:
)
sys.exit(0)
# bfloat16 is only supported by CUDA 11+
BFLOAT16_AVAILABLE = torch.cuda.is_available() and (
torch.version.cuda is not None or torch.version.hip is not None
)