fems14 1c9f0fe26f Fix of DeepSeek Error in KV Pool Mixed Deployment Scenario (#3087) ...

### What this PR does / why we need it?
A new kv_role "kv_both" is added to run mixed deployment scenarios. The
mixed deployment will involve a decode phase, where with_prefill should
be false.

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

- vLLM version: v0.10.2
- vLLM main:
c60e6137f0

Signed-off-by: fems14 <1804143737@qq.com>

2025-09-22 20:36:41 +08:00

..

disaggregated_prefill_v1

Fix of DeepSeek Error in KV Pool Mixed Deployment Scenario (#3087)

2025-09-22 20:36:41 +08:00

eplb

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

external_online_dp

[Feature] Support moe multi-stream for aclgraph. (#2946)

2025-09-19 11:06:45 +08:00

offline_data_parallel.py

[Misc] Add extra checking to torchair_graph_config. (#1939)

2025-08-01 09:24:11 +08:00

offline_disaggregated_prefill_npu.py

[BugFix] update the kv transfer config (#2121)

2025-08-01 08:56:55 +08:00

offline_dualbatch_overlap_npu.py

[main][refactor] Refactoring forward_context and model_runner_v1 (#1979)

2025-07-28 14:06:20 +08:00

offline_embed.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_external_launcher.py

ut: add example and e2e test for sleepmode in external_launcher (#2152)

2025-08-06 11:11:53 +08:00

offline_inference_audio_language.py

Fix some ci issue and refactor modelrunner (#2445)

2025-08-20 09:01:04 +08:00

offline_inference_npu_tp2.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_inference_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

offline_inference_sleep_mode_npu.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

prompt_embedding_inference.py

[Misc][V0 Deprecation] Add __main__ guard to all offline examples (#1837)

2025-07-17 14:13:30 +08:00

run_dp_server.sh

[Feature] Support moe multi-stream for aclgraph. (#2946)

2025-09-19 11:06:45 +08:00