Zhang Yulong b4014834a9 Extend sleep time to 10 seconds in switch_service (#4618) ...

Increase sleep duration before switching services.

2025-10-28 15:19:21 +08:00

..

benchmarks

[CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558)

2025-10-24 16:46:45 +08:00

cache_manager

[bugfix] kill cache_transfer_manager process (#4401)

2025-10-16 20:45:24 +08:00

ce

Extend sleep time to 10 seconds in switch_service (#4618)

2025-10-28 15:19:21 +08:00

ci_use

[CI] Relocate server test cases from ci_use directory to e2e (#4608)

2025-10-28 11:37:30 +08:00

distributed

[BugFix]Dev fix custom ar unstable result (#4437)

2025-10-17 11:47:16 +08:00

e2e

[CI] Relocate server test cases from ci_use directory to e2e (#4608)

2025-10-28 11:37:30 +08:00

engine

[Feature] Support AsyncLLM (#4458)

2025-10-22 15:50:12 +08:00

entrypoints

fix_run_batch_unittest (#4613)

2025-10-28 10:38:06 +08:00

graph_optimization

[Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578)

2025-10-24 18:36:52 +08:00

input

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

inter_communicator

perf: Optimize task queue communication from engine to worker (#4531)

2025-10-25 22:45:38 +08:00

layers

[Unitest]Add unitest of Attention Layer (#4494)

2025-10-27 19:18:50 +08:00

logger

[BugFix] PaddleOCR-VL fix FD_DEBUG type and support v1 loader (#4605)

2025-10-28 09:47:47 +08:00

metrics

[fix] Fixed the issue of excessive/redundant spans being returned for streaming requests. (#4375)

2025-10-15 11:47:47 +08:00

model_executor

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

model_loader

[V1 loader] Qwen25 VL support v1 loader and torch style safetensors load (#4388)

2025-10-27 10:54:15 +08:00

multimodal

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

operators

Add comprehensive unit tests for limit_thinking_content_length operators (#4510)

2025-10-21 18:55:57 +08:00

output

[Speculative Decoding] Add draft_logprobs Support for Speculative Decode MTP (#4467)

2025-10-21 14:57:50 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

pooling

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

[Supplements and upgrades]Improvement of X1 parsers (#4172)

2025-09-26 13:37:37 +08:00

utils

【feature】support n parameter (#4273)

2025-10-17 20:51:59 +08:00

v1

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

conftest.py

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

cov_pytest.ini

[CI] Handle unit test issues (#4483)

2025-10-20 10:13:21 +08:00

utils.py

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00