254 Commits

Author	SHA1	Message	Date
K11OntheBoat	4515ad21e9	Support limit thinking lengths (#4069) ... Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>	2025-09-25 19:55:56 +08:00
ooo oo	e36eccfdad	【Hackathon 9th No.21、23】add unit tests for fused_hadamard_quant_fp8, moe_fused_hadamard_quant_fp8 (#4094) ... * test: add unit tests for fused_hadamard_quant_fp8 * test: add unit tests for moe_fused_hadamard_quant_fp8 * tests: simulate CUDA kernel's hadamard32_warp using butterfly operations * apply review * apply review	2025-09-25 12:15:00 +08:00
CSWYF3634076	5ff10c8ced	[Model] Qwen2.5VL support --use-cudagraph and unit testing (#4087) ... * [BugFix] qwen2.5vl enable_thinking=true and image_patch_id bug fix * [Docs]offine infer add apply_chat_template add_generation_prompt parameter * [Model]qwen2.5VL support --use-cudagraph * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v2 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v3 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v4 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v5 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v6 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v7	2025-09-24 19:45:01 +08:00
luukunn	18f4977aec	[fix]update apply_chat_template (#4137) ... * update apply_chat_template * fix unittest * fix unittest * fix * fix * fix unit test * fix * fix unit test * add unit test	2025-09-24 18:56:32 +08:00
chen	7c1fd19f0f	[OPs] MoE support wfp8afp8(channelwise) and improve per_token_quant_fp8 (#4238)	2025-09-24 16:39:51 +08:00
memoryCoderC	8b0ce8e3ab	[Feature] add cli command serve (#4226)	2025-09-24 14:50:45 +08:00
co63oc	a1c5d930bb	【Hackathon 9th No.24】add rebuild_padding (#4107)	2025-09-24 12:08:17 +08:00
chen	ec99474e71	[Test]add glm45_air logprob test and rollout model (#4175) ... * add glm45_air logprob test * add glm rollout model and pretrainedmodel for rl * add glm rollout model and test * check * delete cudagraph in glm45 * add UT for glm rollout model * revert glm UT	2025-09-23 21:06:07 +08:00
bukejiyu	62d1c48363	[v1 loader]code style (#4204) ... * code style * update	2025-09-23 19:36:00 +08:00
chen	1a6283424e	Fix noaux_tc cuda Error 700 in CUDAGraph (#4174)	2025-09-23 18:41:33 +08:00
lizexu123	c96a535a5d	[Feature] support qwen3-embedding model load (#4202) ... * support qwen3-embedding * fix ci bug * fix * fix ci bug * fix ci bug * fix	2025-09-23 00:14:35 -07:00
yangjianfengo1	4325b737e7	【FIX】Change the name of sparse attn from moba to plas (#4006) (#4076) ... * 【FIX】Change the name of sparse attn from moba to plas (#4006) * 更新文档 * 【docs】 update readme (#4000) * 更新文档 * update readme * update docs * 【FIX】Change the name of sparse attn from moba to plas (#3845) * 更新文档 * 更新文档 * 更新文档 * 更新文档 * 修改moba为plas * code style * update ci * code style * update ci * code style --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> * fix max_num_seqs * fix test load attn --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-23 10:26:40 +08:00
plusNew001	2c34a557f4	[XPU]change xpu ci model (#4117) ... * change xpu ci model * change xpu ci model * change xpu ci model * change xpu ci model * Update model path and XPU settings in run_ci_xpu.sh * Increase health check timeout to 10 minutes Increased the timeout duration for health checks from 5 minutes to 10 minutes in two places. * Implement test for OpenAI chat completion Add a test function for the OpenAI client chat response. * Change script to use pytest for running tests * Update health check timeout to 15 minutes Increase the timeout for health checks from 10 minutes to 15 minutes. * Add pytest installation to CI script * Modify base response in test_45t function Updated the base response message for the test. * Add V0 and V1 mode test echo statements --------- Co-authored-by: root <root@yq01-inf-hic-k8s-a100-aa24-0591.yq01.baidu.com>	2025-09-23 10:21:17 +08:00
ltd0924	83720da79f	[Feature] support clear data (#3601) ... * [Feature] support clear data * update * fix * fix * fix * fix * fix * fix * fix	2025-09-23 10:20:02 +08:00
yzwu	504461b6b5	[Iluvatar GPU] Optimize attention performance and fix moe load ckpt error (#3651)	2025-09-22 21:13:59 +08:00
Zhang Yulong	5532e8a323	[FD CLI] Add bench cli (#4160) ... * add bench cli * Update test_main.py	2025-09-22 20:37:30 +08:00
Echo-Nie	5e1f13bd3b	add test_set_value_by_flags_and_idx.py (#4186)	2025-09-22 20:21:34 +08:00
co63oc	c5671d7c09	[MTP][Unit Test]add test_top_p_candidates (#4046) ... * add test_top_p_candidates * fix * fix * fix	2025-09-22 17:06:38 +08:00
Echo-Nie	9845f0d010	【Hackathon 9th No.30】add test_tritonmoe_preprocess (#3891) ... * add test_tritonmoe_preprocess * add value check * del test_support_all...	2025-09-22 15:31:32 +08:00
co63oc	c4830ef24c	fix typos (#4176) ... * fix typos * fix	2025-09-22 14:27:17 +08:00
Divano	0b62648924	test xly ci	2025-09-22 14:13:00 +08:00
lizexu123	c86945ef49	[Feature] support pool (#3827) ... * support pool * update pooling * add pooler_config and check * update * support AutoWeightsLoader load weight * fix * update * delete print * update pre-commit * fix * fix xpu * fix ModelRegistry->model_registry * fix Copilot review * fix pooler.py * delete StepPooler * fix abstract * fix default_loader_v1 * fix Pre Commit * support torch qwen3 dense * add test and fix torch-qwen * fix * fix * adapter ci: * fix review * fix pooling_params.py * fix * fix tasks.py 2025 * fix print and logger * Modefy ModelRegistry and delete AutoWeightsLoader * fix logger * fix test_embedding * fix ci bug * ernie4_5 model_registry * fix test * support Qwen3-Embedding-0.6B tp=1 load * fix extra code * fix * delete fix vocab_size * delete prepare_params_dict * fix:	2025-09-22 14:09:09 +08:00
Echo-Nie	cc6e14d2ec	【Hackathon 9th No.46】add test_fused_rotary_position_encoding (#3848) ... * add test_fused_rotary_position_encoding * 添加版权 * fix according to the review	2025-09-19 17:50:19 +08:00
YuanRisheng	24180fba0a	[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147) ... * remove splitwise_role and engine_worker_queue_port * fix xpu * fix xpu * fix xpu * fix unittest * resolve conflct	2025-09-19 17:01:52 +08:00
luukunn	ee9d8a840a	[fix]Modify follow-up push parameters and Modify the verification method for thinking length (#4086) ... * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * add completion_token_ids * add logger * fix reasoning_max_tokens ParameterError * add unittest * add unittest * add unittest * add unittest * add unittest * add unit test	2025-09-19 14:26:01 +08:00
xiaolei373	ddf5606263	Bugfix test exception (#4171) ... * feat(log):add_request_and_response_log * modify default error type	2025-09-19 11:48:49 +08:00
Sunny-bot1	c3b8ebeb18	[Optimize] Machete using group scale default (#4121)	2025-09-18 13:51:11 +08:00
qwes5s5	62b8b02e08	fix_unitest (#4159) ... Co-authored-by: K11OntheBoat <your_email@example.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-09-18 11:17:15 +08:00
chenjian	618ccdbfba	[Feature] Support mixed deployment with yiyan adapter in develop (#3976) ... * [Feature] Support mixed deployment with yiyan adapter in release2.2 * fix metrics * add unit test * add unit test * add unit test * fix ci * fix for eb5 * fix ci * fix ci * fix ci --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-18 01:52:20 +08:00
YuBaoku	2745f37017	[CI] enhance clean port and add waiting time (#4152)	2025-09-17 20:31:49 +08:00
gaoziyuan	896e3bb606	[NewFeture]add ep rollout model init and update/clear ep buffer (#4039) ... * fix gid * merge * fix test * fix bug * fix * fix ci	2025-09-17 20:24:53 +08:00
YuanRisheng	0d3a57a2c6	fix unittest (#4155)	2025-09-17 20:20:26 +08:00
YuanRisheng	2e9e53ff7e	[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116) ... * remove max_num_batched_tokens in parallel config * remove max_num_seqs * update test case * fix test * fix --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-17 10:43:35 +08:00
YUNSHEN XIE	c01a756912	mv test to tests (#4129)	2025-09-16 20:45:40 +08:00
Zhang Yulong	cd09913552	Update test_w4a8_model.py (#4125)	2025-09-16 20:43:10 +08:00
chenjian	67e6d8c691	[Feature] Set prefix caching as default (#3814) ... * Set prefix caching as default * Set prefix caching as default * Set prefix caching as default * skip dynamic load scene * fix kill bug * fix kill bug * fix kill bug * fix * fix * fix ci	2025-09-16 20:34:27 +08:00
Yuan Xiaolan	de8638b1e9	fix dynamic Cfp8 computing error (#4119) ... Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-09-16 20:21:49 +08:00
Divano	8e49d99009	Addcase (#4112) ... logprob 没跑，不影响，增加校验openai 异常情况下 错误输出格式字段的case	2025-09-16 16:12:14 +08:00
co63oc	b70ca35c0b	【Hackathon 9th No.52】add test_dynamic_per_token_scaled_fp8_quant (#4015) ... * add test_dynamic_per_token_scaled_fp8_quant * fix * add bfloat16 * ci	2025-09-16 14:11:29 +08:00
Echo-Nie	befe463f01	【Hackathon 9th No.37】add test_top_k_renorm_probs (#3755) ... * add test_top_k_renorm_probs.py * add size=2,3	2025-09-16 11:12:46 +08:00
co63oc	17a27170bc	fix typos (#4093)	2025-09-15 18:33:30 +08:00
bukejiyu	29ed617f0f	[v1 loader]qwen Offline fp8 (#4036) ... * support offline fp8 * update ut * update ut * update ut * fix * update * update	2025-09-15 13:44:11 +08:00
Sunny-bot1	b1a5b756a3	[Optimize] Support WINT8 and group scale for Machete (#3905)	2025-09-15 12:01:34 +08:00
Echo-Nie	4408dc7f67	【Hackathon 9th No.49】add test_pre_cache_len_concat (#3847) ... * add test_pre_cache_len_concat * fix according review, add ref_pre_cache_len_concat	2025-09-15 11:20:14 +08:00
co63oc	ef4a1aa2da	【Hackathon 9th No.61、65】add test_draft_model_update (#3940) ... * add draft_model_update test * fix * fix * fix * fix * fix	2025-09-15 11:19:50 +08:00
qwes5s5	553adb299e	【FastDeploy CLI】collect-env subcommand (#4044) ... * collect-env subcommand * trigger ci --------- Co-authored-by: K11OntheBoat <your_email@example.com>	2025-09-15 10:31:23 +08:00
zhouchong	958abebeab	Support offline inference with streaming output (#4071) ... * Support offline inference with streaming output * add unit test --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-15 10:27:03 +08:00
xiaolei373	9ac539471d	[format] Valid para format error info (#4035) ... * feat(log):add_request_and_response_log * 报错信息与OpenAI对齐	2025-09-12 19:05:17 +08:00
YuanRisheng	88ea565aba	[BugFix]Fix load kv cache quant scale (#4077) ... * fix kv cache * fix kv_cache * fix kv cache	2025-09-12 17:44:03 +08:00
co63oc	c86b3357ce	【Hackathon 9th No.78】add test_chat.py (#3958)	2025-09-12 16:53:27 +08:00