mirror of
https://github.com/vllm-project/vllm.git
synced 2025-10-20 14:53:52 +08:00
[Misc] Add references in ray_serve_deepseek example (#17907)
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
This commit is contained in:
@ -1,7 +1,9 @@
|
||||
# SPDX-License-Identifier: Apache-2.0
|
||||
"""
|
||||
Example to deploy DeepSeek R1 or V3 with Ray Serve LLM.
|
||||
See Ray Serve LLM documentation at:
|
||||
See more details at:
|
||||
https://docs.ray.io/en/latest/serve/tutorials/serve-deepseek.html
|
||||
And see Ray Serve LLM documentation at:
|
||||
https://docs.ray.io/en/latest/serve/llm/serving-llms.html
|
||||
|
||||
Run `python3 ray_serve_deepseek.py` to deploy the model.
|
||||
|
Reference in New Issue
Block a user