frozenleaves/vllm
1
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2025-10-20 23:03:52 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] fix detokenizer shallow copy (#5919)

Browse Source
This commit is contained in:
Aurick Qiao
2024-10-22 18:38:12 -04:00
committed by GitHub
parent 17c79f3c36
commit 23b899a8e6
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/transformers_utils/detokenizer.py
View File

@ -90,7 +90,7 @@ class Detokenizer:
prefix_offset = next_iter_prefix_offset
read_offset = next_iter_read_offset
if prev_tokens is None:
prev_tokens = next_iter_tokens
prev_tokens = next_iter_tokens.copy()
else:
prev_tokens.extend(next_iter_tokens)