mirror of https://github.com/vllm-project/vllm.git synced 2025-10-21 07:13:52 +08:00

Files

Morrison Turnansky 96b9aa5aa0 [Frontend][torch.compile] CompilationConfig Overhaul (#20283 ): name change compilation level to compilation mode, deprecation compilation level (#26355 )

Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2025-10-15 02:51:16 +00:00

conserving_memory.md

[Frontend][torch.compile] CompilationConfig Overhaul (#20283 ): name change compilation level to compilation mode, deprecation compilation level (#26355 )

2025-10-15 02:51:16 +00:00

engine_args.md

[Docs] Add comprehensive CLI reference for all large vllm subcommands (#22601 )

2025-08-11 00:13:33 -07:00

env_vars.md

Make distinct code and console admonitions so readers are less likely to miss them (#20585 )

2025-07-07 19:55:28 -07:00

model_resolution.md

[Misc] unify variable for LLM instance (#20996 )

2025-07-21 12:18:33 +01:00

optimization.md

[Doc] ruff format some Python examples (#26767 )

2025-10-14 03:21:53 -07:00

README.md

[Doc] Move examples and further reorganize user guide (#18666 )

2025-05-26 07:38:04 -07:00

serve_args.md

Add full serve CLI reference back to docs (#20978 )

2025-07-15 17:42:30 +00:00

tpu.md

[Docs] Fix a 1-2-3 list and style issues in tpu.md (#23729 )

2025-08-27 05:37:52 -07:00

README.md

Configuration Options

This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

[Request parameters][completions-api] and [input arguments][sampling-params]
Engine arguments
Environment variables