bukejiyu 29ed617f0f [v1 loader]qwen Offline fp8 (#4036) ...

* support offline fp8

* update ut

* update ut

* update ut

* fix

* update

* update

2025-09-15 13:44:11 +08:00

..

ce

[format] Valid para format error info (#4035)

2025-09-12 19:05:17 +08:00

ci_use

Support offline inference with streaming output (#4071)

2025-09-15 10:27:03 +08:00

distributed

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

e2e

[Feature] GLM-45-AIR Support Mix Quantization(Dense wfp8afp8 and wint8 triton_moe_backend) (#4051)

2025-09-11 20:08:09 +08:00

entrypoints

【FastDeploy CLI】collect-env subcommand (#4044)

2025-09-15 10:31:23 +08:00

graph_optimization

[Excutor] Experiment Feature-Support Prefill in cudagraph (#3459)

2025-09-08 13:12:24 +08:00

input

[bug fix] Fix the placeholder in qwen prompt and add some unittests (#4065)

2025-09-11 20:00:02 +08:00

layers

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

logger

fix test name (#3493)

2025-08-22 23:43:47 +08:00

metrics

[metrics] Add serveral observability metrics (#3868)

2025-09-08 14:13:13 +08:00

model_executor

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

model_loader

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

operators

[Optimize] Support WINT8 and group scale for Machete (#3905)

2025-09-15 12:01:34 +08:00

output

add cache queue port (#3904)

2025-09-05 21:17:06 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

【Hackathon 9th No.84】Supplementary Unit Test for fastdeploy/reasoning (#3570)

2025-09-03 10:55:02 +08:00

utils

[format] Valid para format error info (#4035)

2025-09-12 19:05:17 +08:00

v1

[Optimize] optimize prefix cache in develop (#3890)

2025-09-12 10:15:59 +08:00

conftest.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

cov_pytest.ini

update ci (#3962)

2025-09-09 10:09:13 +08:00

utils.py

Add loader test for mtp (#3724)

2025-09-01 10:55:49 +08:00