Ryan 28de91b50f [Graph Optimization] SOT+CUDAGraph support ERNIE4.5T VL 28B / 424B (#4645) ...

* 45TVL support sot+CUDAGraph

* mv unitest from ce_deploy 2 e2e

* add test_EB_VL_Lite_sot_serving

* rm useless line

* add openai_client

* fix unitest && reduce computing resources

2025-10-31 11:38:43 +08:00

..

benchmarks

[CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558)

2025-10-24 16:46:45 +08:00

cache_manager

[bugfix] kill cache_transfer_manager process (#4401)

2025-10-16 20:45:24 +08:00

ce

[Feature] add mm token usage (#4570)

2025-10-29 14:37:12 +08:00

ci_use

[XPU] [CI] Add Vl case (#4649)

2025-10-31 10:38:09 +08:00

distributed

[BugFix]Dev fix custom ar unstable result (#4437)

2025-10-17 11:47:16 +08:00

e2e

[Graph Optimization] SOT+CUDAGraph support ERNIE4.5T VL 28B / 424B (#4645)

2025-10-31 11:38:43 +08:00

engine

fix total_block_num init error in worker_process (#4687)

2025-10-30 19:53:09 +08:00

entrypoints

[Feature] Unify the registration name recognition for tool_parser and reasoning_parser to “-” (#4668)

2025-10-31 10:45:27 +08:00

graph_optimization

[BugFix] Fix graph opt test case (#4634)

2025-10-29 13:28:04 +08:00

input

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

inter_communicator

perf: Optimize task queue communication from engine to worker (#4531)

2025-10-25 22:45:38 +08:00

layers

add real gate_correction_bias weight to mock un-balanced dispatch (#4676)

2025-10-30 15:13:21 +08:00

logger

[BugFix] PaddleOCR-VL fix FD_DEBUG type and support v1 loader (#4605)

2025-10-28 09:47:47 +08:00

metrics

[fix] Fixed the issue of excessive/redundant spans being returned for streaming requests. (#4375)

2025-10-15 11:47:47 +08:00

model_executor

[Feature] support logits processors (#4515)

2025-10-29 00:08:53 +08:00

model_loader

[V1 loader] Qwen25 VL support v1 loader and torch style safetensors load (#4388)

2025-10-27 10:54:15 +08:00

multimodal

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

operators

Add ut for speculative sampler (#4650)

2025-10-30 10:37:49 +08:00

output

[BugFix] fix unittest of get_save_output_v1 (#4701)

2025-10-31 11:23:49 +08:00

platforms

…

plugins

…

pooling

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

quantization

…

reasoning

[Feature] Unify the registration name recognition for tool_parser and reasoning_parser to “-” (#4668)

2025-10-31 10:45:27 +08:00

utils

【feature】support n parameter (#4273)

2025-10-17 20:51:59 +08:00

v1

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

conftest.py

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

cov_pytest.ini

[CI] Handle unit test issues (#4483)

2025-10-20 10:13:21 +08:00

utils.py

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00