237 Commits

Author	SHA1	Message	Date
K11OntheBoat	05b7800d80	Support limit thinking lengths (#4244) ... Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>	2025-09-24 17:30:53 +08:00
Echo-Nie	9845f0d010	【Hackathon 9th No.30】add test_tritonmoe_preprocess (#3891) ... * add test_tritonmoe_preprocess * add value check * del test_support_all...	2025-09-22 15:31:32 +08:00
co63oc	c4830ef24c	fix typos (#4176) ... * fix typos * fix	2025-09-22 14:27:17 +08:00
Divano	0b62648924	test xly ci	2025-09-22 14:13:00 +08:00
lizexu123	c86945ef49	[Feature] support pool (#3827) ... * support pool * update pooling * add pooler_config and check * update * support AutoWeightsLoader load weight * fix * update * delete print * update pre-commit * fix * fix xpu * fix ModelRegistry->model_registry * fix Copilot review * fix pooler.py * delete StepPooler * fix abstract * fix default_loader_v1 * fix Pre Commit * support torch qwen3 dense * add test and fix torch-qwen * fix * fix * adapter ci: * fix review * fix pooling_params.py * fix * fix tasks.py 2025 * fix print and logger * Modefy ModelRegistry and delete AutoWeightsLoader * fix logger * fix test_embedding * fix ci bug * ernie4_5 model_registry * fix test * support Qwen3-Embedding-0.6B tp=1 load * fix extra code * fix * delete fix vocab_size * delete prepare_params_dict * fix:	2025-09-22 14:09:09 +08:00
Echo-Nie	cc6e14d2ec	【Hackathon 9th No.46】add test_fused_rotary_position_encoding (#3848) ... * add test_fused_rotary_position_encoding * 添加版权 * fix according to the review	2025-09-19 17:50:19 +08:00
YuanRisheng	24180fba0a	[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147) ... * remove splitwise_role and engine_worker_queue_port * fix xpu * fix xpu * fix xpu * fix unittest * resolve conflct	2025-09-19 17:01:52 +08:00
luukunn	ee9d8a840a	[fix]Modify follow-up push parameters and Modify the verification method for thinking length (#4086) ... * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * 续推参数 generated_token_ids 修改成 completion_token_ids;修改思考长度校验方式 * add completion_token_ids * add logger * fix reasoning_max_tokens ParameterError * add unittest * add unittest * add unittest * add unittest * add unittest * add unit test	2025-09-19 14:26:01 +08:00
xiaolei373	ddf5606263	Bugfix test exception (#4171) ... * feat(log):add_request_and_response_log * modify default error type	2025-09-19 11:48:49 +08:00
Sunny-bot1	c3b8ebeb18	[Optimize] Machete using group scale default (#4121)	2025-09-18 13:51:11 +08:00
qwes5s5	62b8b02e08	fix_unitest (#4159) ... Co-authored-by: K11OntheBoat <your_email@example.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-09-18 11:17:15 +08:00
chenjian	618ccdbfba	[Feature] Support mixed deployment with yiyan adapter in develop (#3976) ... * [Feature] Support mixed deployment with yiyan adapter in release2.2 * fix metrics * add unit test * add unit test * add unit test * fix ci * fix for eb5 * fix ci * fix ci * fix ci --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-18 01:52:20 +08:00
YuBaoku	2745f37017	[CI] enhance clean port and add waiting time (#4152)	2025-09-17 20:31:49 +08:00
gaoziyuan	896e3bb606	[NewFeture]add ep rollout model init and update/clear ep buffer (#4039) ... * fix gid * merge * fix test * fix bug * fix * fix ci	2025-09-17 20:24:53 +08:00
YuanRisheng	0d3a57a2c6	fix unittest (#4155)	2025-09-17 20:20:26 +08:00
YuanRisheng	2e9e53ff7e	[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116) ... * remove max_num_batched_tokens in parallel config * remove max_num_seqs * update test case * fix test * fix --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-17 10:43:35 +08:00
YUNSHEN XIE	c01a756912	mv test to tests (#4129)	2025-09-16 20:45:40 +08:00
Zhang Yulong	cd09913552	Update test_w4a8_model.py (#4125)	2025-09-16 20:43:10 +08:00
chenjian	67e6d8c691	[Feature] Set prefix caching as default (#3814) ... * Set prefix caching as default * Set prefix caching as default * Set prefix caching as default * skip dynamic load scene * fix kill bug * fix kill bug * fix kill bug * fix * fix * fix ci	2025-09-16 20:34:27 +08:00
Yuan Xiaolan	de8638b1e9	fix dynamic Cfp8 computing error (#4119) ... Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-09-16 20:21:49 +08:00
Divano	8e49d99009	Addcase (#4112) ... logprob 没跑，不影响，增加校验openai 异常情况下 错误输出格式字段的case	2025-09-16 16:12:14 +08:00
co63oc	b70ca35c0b	【Hackathon 9th No.52】add test_dynamic_per_token_scaled_fp8_quant (#4015) ... * add test_dynamic_per_token_scaled_fp8_quant * fix * add bfloat16 * ci	2025-09-16 14:11:29 +08:00
Echo-Nie	befe463f01	【Hackathon 9th No.37】add test_top_k_renorm_probs (#3755) ... * add test_top_k_renorm_probs.py * add size=2,3	2025-09-16 11:12:46 +08:00
co63oc	17a27170bc	fix typos (#4093)	2025-09-15 18:33:30 +08:00
bukejiyu	29ed617f0f	[v1 loader]qwen Offline fp8 (#4036) ... * support offline fp8 * update ut * update ut * update ut * fix * update * update	2025-09-15 13:44:11 +08:00
Sunny-bot1	b1a5b756a3	[Optimize] Support WINT8 and group scale for Machete (#3905)	2025-09-15 12:01:34 +08:00
Echo-Nie	4408dc7f67	【Hackathon 9th No.49】add test_pre_cache_len_concat (#3847) ... * add test_pre_cache_len_concat * fix according review, add ref_pre_cache_len_concat	2025-09-15 11:20:14 +08:00
co63oc	ef4a1aa2da	【Hackathon 9th No.61、65】add test_draft_model_update (#3940) ... * add draft_model_update test * fix * fix * fix * fix * fix	2025-09-15 11:19:50 +08:00
qwes5s5	553adb299e	【FastDeploy CLI】collect-env subcommand (#4044) ... * collect-env subcommand * trigger ci --------- Co-authored-by: K11OntheBoat <your_email@example.com>	2025-09-15 10:31:23 +08:00
zhouchong	958abebeab	Support offline inference with streaming output (#4071) ... * Support offline inference with streaming output * add unit test --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-15 10:27:03 +08:00
xiaolei373	9ac539471d	[format] Valid para format error info (#4035) ... * feat(log):add_request_and_response_log * 报错信息与OpenAI对齐	2025-09-12 19:05:17 +08:00
YuanRisheng	88ea565aba	[BugFix]Fix load kv cache quant scale (#4077) ... * fix kv cache * fix kv_cache * fix kv cache	2025-09-12 17:44:03 +08:00
co63oc	c86b3357ce	【Hackathon 9th No.78】add test_chat.py (#3958)	2025-09-12 16:53:27 +08:00
Echo-Nie	06f4b49ca3	【Hackathon 9th No.25】add test_fused_get_rotary_embedding (#3892) ... * add test_fused_get_rotary_embedding * 增加基于 NumPy 的基准实现 * 添加，开源软件的版权和许可声明	2025-09-12 15:38:43 +08:00
ltd0924	cab7a633fe	[CI] add multi api server test (#4049) ... * [BugFix] fix max streaming tokens invalid * fix scheduler bug * fix scheduler bug * Update multi_api_server.py * Create test_multi_api_server.py * fix	2025-09-12 11:18:38 +08:00
chenjian	37f1632732	[Optimize] optimize prefix cache in develop (#3890) ... * optimize prefix cache in release22 * fix * fix * fix * add ci for v1 * add unit test --------- Co-authored-by: xiegegege <46314656+xiegegege@users.noreply.github.com>	2025-09-12 10:15:59 +08:00
chen	4859f40b20	[Feature] GLM-45-AIR Support Mix Quantization(Dense wfp8afp8 and wint8 triton_moe_backend) (#4051)	2025-09-11 20:08:09 +08:00
lddfym	2056a428bd	[bug fix] Fix the placeholder in qwen prompt and add some unittests (#4065) ... * fix the placeholder in qwen prompt * fix the placeholder in qwen prompt * add soem unittests for qwen_vl_processor	2025-09-11 20:00:02 +08:00
memoryCoderC	850465e8ed	[Feature] add cli command chat,complete (#4037)	2025-09-11 19:53:14 +08:00
zhuzixuan	a47976e82d	[Echo] Support more types of prompt echo (#4022) ... * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. * wenxin-tools-700 When the prompt type is list[int] or list[list[int]], it needs to support echoing after decoding. --------- Co-authored-by: luukunn <83932082+luukunn@users.noreply.github.com>	2025-09-11 19:34:44 +08:00
YuBaoku	fec58639db	[CI] skip test_structured_outputs* temporarily (#4055)	2025-09-11 18:07:50 +08:00
SuperNova	d60f7c4661	fix import tests.utils error in tests/model_loader/test_load_mtp.py (#4027) ... Co-authored-by: yongqiangma <xing.wo@163.com>	2025-09-11 16:47:16 +08:00
bukejiyu	2650f58740	[docs] Update environment variables documentation (#3957)	2025-09-10 21:17:06 -07:00
co63oc	2af0f671b1	【Hackathon 9th No.55】add test_update_inputs_v1.py (#3992)	2025-09-11 11:34:22 +08:00
AIbin	a7392a0ff9	【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886) ... * support MLA chunk_size auto search & cuda_graph	2025-09-11 10:46:09 +08:00
chen	637d96c6ae	[Feature] Support zai-org/GLM-4.5-Air BF16 model (#3928) ... * support glm45_air	2025-09-10 19:36:10 +08:00
wanrui	276f73cf83	【Hackathon 9th No.28】add test_cutlass_fp8_fp8_fp8_dual_gemm_fused (#3935) ... * add test_cutlass_fp8_fp8_fp8_dual_gemm_fused * fix the version * fix code style --------- Co-authored-by: Tao Luo <luotao02@baidu.com>	2025-09-10 14:57:49 +08:00
Sunny-bot1	3b1da6e4dd	support v1 loader for machete (#3999)	2025-09-10 10:21:33 +08:00
YuanRisheng	b3fac5bde1	[V1 Loader] Ernie kv cache quant support v1 loader (#3899) ... * support c8 for ernie * add unittest * support vl * fix c8	2025-09-09 05:25:08 -07:00
Jiang-Jia-Jun	c60adf4281	Revert "【FIX】Change the name of sparse attn from moba to plas (#3845)" (#4001) ... This reverts commit e31c8f7336.	2025-09-09 11:08:23 +08:00