Lucas Wilkinson c2bba69065 [BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2025-10-18 22:05:23 +00:00

..

assets

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

attention

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

benchmarks

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

compilation

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

config

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

device_allocator

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

distributed

[Minor] Add some clarifying comments to recent changes (#27130)

2025-10-18 09:52:45 -07:00

engine

[fix][cpu] fix prefill attention in CPU attention backend (#27035)

2025-10-18 13:30:21 +00:00

entrypoints

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515)

2025-10-17 21:55:54 -07:00

executor

[Chore] Rename utils submodules (#26920)

2025-10-16 03:58:13 +00:00

inputs

[Docs] Replace rst style double-backtick with md single-backtick (#27091)

2025-10-17 02:47:34 -07:00

logging_utils

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

lora

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

model_executor

[BugFix] Disable fp8 kv-cache by default for DeepSeek V3.2 (#27121)

2025-10-18 22:05:23 +00:00

multimodal

[Chore] Separate out vllm.utils.mem_utils (#27143)

2025-10-18 10:06:59 +00:00

platforms

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

plugins

[Chore] Separate out vllm.utils.importlib (#27022)

2025-10-17 00:48:59 +00:00

profiler

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

ray

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

reasoning

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515)

2025-10-17 21:55:54 -07:00

third_party

fix some typos (#24071)

2025-09-02 20:44:50 -07:00

transformers_utils

Remove unused imports (#26972)

2025-10-16 19:51:17 -07:00

triton_utils

[Misc] Update TritonLanguagePlaceholder to have attributes that are used by Flash Linear Attention ops. (#26853)

2025-10-15 08:37:49 +00:00

usage

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

utils

[Chore] Separate out profiling utilities from vllm.utils (#27150)

2025-10-18 19:12:01 +00:00

v1

[Minor] Add some clarifying comments to recent changes (#27130)

2025-10-18 09:52:45 -07:00

vllm_flash_attn

[BugFix] Fix vllm_flash_attn install issues (#17267)

2025-04-27 17:27:56 -07:00

__init__.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

_bc_linter.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

_custom_ops.py

[Chore] Remove unused PolyNorm layer (#27110)

2025-10-17 19:03:43 +00:00

_ipex_ops.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

beam_search.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

collect_env.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

connections.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

env_override.py

[BugFix] fix graph partition signature (#27139)

2025-10-18 17:34:36 -04:00

envs.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

forward_context.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

logger.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

logits_process.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

logprobs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

outputs.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

pooling_params.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

py.typed

Add py.typed so consumers of vLLM can get type checking (#1509)

2023-10-30 14:50:47 -07:00

sampling_params.py

[GPT-OSS] Structure_Tag support for gpt-oss tool-call in cot (#25515)

2025-10-17 21:55:54 -07:00

scalar_type.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

scripts.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

sequence.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

tasks.py

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370)

2025-10-15 11:14:41 +00:00

test_utils.py

Remove V0 Encoder-Decoder Support (#24907)

2025-09-15 21:17:14 -07:00

tracing.py

[Chore] Rename utils submodules (#26920)

2025-10-16 03:58:13 +00:00

version.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00