[Feature] remove dependency on enable_mm and refine multimodal's code (#3014)

* remove dependency on enable_mm

* fix codestyle check error

* fix codestyle check error

* update docs

* resolve conflicts on model config

* fix unit test error

* fix code style check error

---------

Co-authored-by: shige <1021937542@qq.com>
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
This commit is contained in:
ApplEOFDiscord
2025-08-01 20:01:18 +08:00
committed by GitHub
parent 243394044d
commit b71cbb466d
24 changed files with 118 additions and 29 deletions

View File

@@ -17,7 +17,7 @@
| ```tokenizer``` | `str` | tokenizer 名或路径,默认为模型路径 |
| ```use_warmup``` | `int` | 是否在启动时进行warmup会自动生成极限长度数据进行warmup默认自动计算KV Cache时会使用 |
| ```limit_mm_per_prompt``` | `dict[str]` | 限制每个prompt中多模态数据的数量{"image": 10, "video": 3}默认都为1 |
| ```enable_mm``` | `bool` | 是否支持多模态数据仅针对多模模型默认False |
| ```enable_mm``` | `bool` | __[已废弃]__ 是否支持多模态数据仅针对多模模型默认False |
| ```quantization``` | `str` | 模型量化策略当在加载BF16 CKPT时指定wint4或wint8时支持无损在线4bit/8bit量化 |
| ```gpu_memory_utilization``` | `float` | GPU显存利用率默认0.9 |
| ```num_gpu_blocks_override``` | `int` | 预分配KVCache块数此参数可由FastDeploy自动根据显存情况计算无需用户配置默认为None |