co63oc 17a27170bc fix typos (#4093)

2025-09-15 18:33:30 +08:00

..

ce

[format] Valid para format error info (#4035)

2025-09-12 19:05:17 +08:00

ci_use

Support offline inference with streaming output (#4071)

2025-09-15 10:27:03 +08:00

distributed

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

e2e

[Feature] GLM-45-AIR Support Mix Quantization(Dense wfp8afp8 and wint8 triton_moe_backend) (#4051)

2025-09-11 20:08:09 +08:00

entrypoints

fix typos (#4093)

2025-09-15 18:33:30 +08:00

graph_optimization

fix typos (#4093)

2025-09-15 18:33:30 +08:00

input

[bug fix] Fix the placeholder in qwen prompt and add some unittests (#4065)

2025-09-11 20:00:02 +08:00

layers

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

logger

fix test name (#3493)

2025-08-22 23:43:47 +08:00

metrics

[metrics] Add serveral observability metrics (#3868)

2025-09-08 14:13:13 +08:00

model_executor

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

model_loader

fix typos (#4093)

2025-09-15 18:33:30 +08:00

operators

[Optimize] Support WINT8 and group scale for Machete (#3905)

2025-09-15 12:01:34 +08:00

output

fix typos (#4093)

2025-09-15 18:33:30 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

【Hackathon 9th No.84】Supplementary Unit Test for fastdeploy/reasoning (#3570)

2025-09-03 10:55:02 +08:00

utils

[format] Valid para format error info (#4035)

2025-09-12 19:05:17 +08:00

v1

[Optimize] optimize prefix cache in develop (#3890)

2025-09-12 10:15:59 +08:00

conftest.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

cov_pytest.ini

update ci (#3962)

2025-09-09 10:09:13 +08:00

utils.py

Add loader test for mtp (#3724)

2025-09-01 10:55:49 +08:00