frozenleaves/vllm
1
0
Fork 0
mirror of https://github.com/vllm-project/vllm.git synced 2025-10-20 14:53:52 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Bugfix] Use "vision_model" prefix for MllamaVisionModel (#9628)

Browse Source 
Signed-off-by: mgoin <michael@neuralmagic.com>
This commit is contained in:
Michael Goin
2024-10-23 22:07:44 -04:00
committed by GitHub
parent bb01f2915e
commit b7df53cd42
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/model_executor/models/mllama.py
View File

@ -1053,7 +1053,8 @@ class MllamaForConditionalGeneration(nn.Module, SupportsMultiModal):
self.image_size = config.vision_config.image_size
self.vision_model = MllamaVisionModel(config.vision_config,
quant_config)
quant_config,
prefix="vision_model")
self.language_model = MllamaForCausalLM(
config.text_config,
cache_config=cache_config,