YuanRisheng 88ea565aba [BugFix]Fix load kv cache quant scale (#4077) ...

* fix kv cache

* fix kv_cache

* fix kv cache

2025-09-12 17:44:03 +08:00

..

ce

update ci (#3962)

2025-09-09 10:09:13 +08:00

ci_use

[CI] skip test_structured_outputs* temporarily (#4055)

2025-09-11 18:07:50 +08:00

distributed

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

e2e

[Feature] GLM-45-AIR Support Mix Quantization(Dense wfp8afp8 and wint8 triton_moe_backend) (#4051)

2025-09-11 20:08:09 +08:00

entrypoints

【Hackathon 9th No.78】add test_chat.py (#3958)

2025-09-12 16:53:27 +08:00

graph_optimization

[Excutor] Experiment Feature-Support Prefill in cudagraph (#3459)

2025-09-08 13:12:24 +08:00

input

[bug fix] Fix the placeholder in qwen prompt and add some unittests (#4065)

2025-09-11 20:00:02 +08:00

layers

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

logger

fix test name (#3493)

2025-08-22 23:43:47 +08:00

metrics

[metrics] Add serveral observability metrics (#3868)

2025-09-08 14:13:13 +08:00

model_executor

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

model_loader

fix import tests.utils error in tests/model_loader/test_load_mtp.py (#4027)

2025-09-11 16:47:16 +08:00

operators

【Hackathon 9th No.25】add test_fused_get_rotary_embedding (#3892)

2025-09-12 15:38:43 +08:00

output

add cache queue port (#3904)

2025-09-05 21:17:06 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

【Hackathon 9th No.84】Supplementary Unit Test for fastdeploy/reasoning (#3570)

2025-09-03 10:55:02 +08:00

utils

Support for async processor added. (#3869)

2025-09-04 19:58:53 +08:00

v1

[Optimize] optimize prefix cache in develop (#3890)

2025-09-12 10:15:59 +08:00

conftest.py

[Code Simplification] delete print (#3729)

2025-08-30 16:19:07 +08:00

cov_pytest.ini

update ci (#3962)

2025-09-09 10:09:13 +08:00

utils.py

Add loader test for mtp (#3724)

2025-09-01 10:55:49 +08:00