frozenleaves/vllm
1
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2025-10-20 23:03:52 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix][Logprobs] Fix logprobs op to support more backend (#21591)

Browse Source 
Signed-off-by: MengqingCao <cmq0113@163.com>
This commit is contained in:
Mengqing Cao
2025-07-25 20:53:07 +08:00
committed by GitHub
parent 46d81d6951
commit f3a683b7c9
1 changed files with 3 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
vllm/v1/sample/ops/logprobs.py
View File

@ -4,8 +4,10 @@
import torch import torch
from vllm.platforms import current_platform
@torch.compile(dynamic=True)
@torch.compile(dynamic=True, backend=current_platform.simple_compile_backend)
def batched_count_greater_than(x: torch.Tensor, def batched_count_greater_than(x: torch.Tensor,
values: torch.Tensor) -> torch.Tensor: values: torch.Tensor) -> torch.Tensor:
""" """