3303 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
李泳桦	ec499a0104	[Cherry-pick] fix requests & block metrics (#4500) ... * [fix] fix requests & block metrics * [chore] rename variables	2025-10-21 10:43:33 +08:00
ltd0924	3cd9d3060a	[Fearture] Support mm model close prefix cache (#4502) ... * support mm prefix cache close * add * fix * fix * fix --------- Co-authored-by: ltd0924 <luotingdan@baidu.com>	2025-10-21 09:56:47 +08:00
YuBaoku	9558912475	[CI] update paddlepaddle-xpu==3.2.0 in 0908 (#4489)	2025-10-20 15:13:27 +08:00
GoldPancake	9c7187998c	[Feature] support mtp logprob (#4457) ... * support logprob in mtp * remove debug code * fix * feat: add draft_logprobs for Speculative Decode MTP * Revert "feat: add draft_logprobs for Speculative Decode MTP" This reverts commit d5a3c5c933. * fix * feat: add draft_logprobs for Speculative Decode MTP * feat: add draft_logprobs for Speculative Decode MTP * fix some bugs * fix codestyle * fix bugs * fix bugs * fix bugs * fix bus * fix bugs * fix unitest --------- Co-authored-by: sunlei1024 <sunlei5788@gmail.com> Co-authored-by: sunlei18 <sunlei18@sunlei18deMacBook-Pro.local>	2025-10-20 10:18:00 +08:00
yangjianfengo1	beaec373c0	[Fix] add einops for requirements (#4477) ... * add einops * add einops	2025-10-17 22:50:26 +08:00
RAM	920df5be5a	[Graph Optimization][Speculative Decoding] Fix the bug of CUDAGraph + MTP + EP (#4430) ... * Fix MTP dummy run bug * Target Model and Draft Model using the same flag * aovid moe bug in cudagraph padding * In mtp replace use_cudagraph as step_use_cudagraph	2025-10-17 14:22:05 +08:00
guozhuangzhuang	cfd93c0966	fix: image token output (#4399) ... * fix: image token output * fix: code style * fix: CompletionOutput.decode_type	2025-10-16 14:51:32 +08:00
Yuanle Liu	83f97d1196	support speculate_limit_thinking_content_length_v2 (#4428) ... * support speculate_limit_thinking_content_length_v2 * fix * fix import	2025-10-16 13:23:16 +08:00
YUNSHEN XIE	0982dfb705	Cherry-Pick PR4033 (#4082) ... * [setup optimize]Support git submodule (#4033) * support git submodule * update setup * fix ci network * fix clone * revert clone linux * delete args * fix ci * update * fix --------- Co-authored-by: YuanRisheng <yuanrisheng@baidu.com>	2025-10-15 22:09:02 +08:00
gaoziyuan	74ae214f1a	fix ep perf (#4381)	2025-10-15 18:38:20 +08:00
freeliuzc	c3499875bd	[MTP]support mtp chunk_prefill_v1 (#4365) ... * support mtp chunk_prefill_v1 * fix mtp chunkprefill output * fix mtp chunkprefill output, fix unit test * fix save_output --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-10-15 15:33:59 +08:00
YuBaoku	55064b8c57	[CI] Fix download instability issues (#4424)	2025-10-15 15:11:14 +08:00
ltd0924	dd425b89ed	[BugFix] fix cache port and zmq close bugs (#4371) ... * Update common_engine.py * Update zmq_client.py * Update expert_service.py --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-10-15 10:29:30 +08:00
yangjianfengo1	bc7193f21d	增加4合一视频选择 (#4372)	2025-10-15 09:58:24 +08:00
ltd0924	fa9a3eef4f	Update token_processor.py (#4395)	2025-10-15 09:43:28 +08:00
freeliuzc	bf12bee887	[MTP][Cfp8]supports spec dynamic cfp8 (#4290) (#4392) ... * supports spec dynamic cfp8 * supports spec dynamic cfp8 --------- Co-authored-by: lzy <569782149@qq.com>	2025-10-14 19:36:41 +08:00
YuBaoku	7b04a1298c	[CI] fix diff_error temporarily (#4391)	2025-10-14 11:50:01 +08:00
Jundong Liu	0b7a5778ab	[Executor]CUDAGraph support Speculate Decode (#4258) ... * [Executor]CUDAGraph support Speculate Decode * fix problem * solve problem * fix * fast compile * CUDAGraph + mtp support eb5(only target model) * Revert "fast compile" This reverts commit 3cfe8373ed. * fix precommit * solve comment * fix comment about #pragram unroll --------- Co-authored-by: gongshaotian <gstain5555@outlook.com> Co-authored-by: gongshaotian <gstian5555@outlook.com>	2025-10-13 15:21:41 +08:00
Zero Rains	07db281647	[Cherry-Pick][BugFix]fix the bug for prefilled_step_idx signal of cache_messager in cudagraph and PD (#4252) ... * fix the bug for prefilled_step_idx signal of cache_messager in cudagraph and PD * support dp	2025-10-13 10:18:53 +08:00
freeliuzc	8d629568f2	[MTP]fix speculate-decoding in dpep mode (#4351)	2025-10-11 17:16:57 +08:00
gaoziyuan	0c4c28d799	Update rollout_model.py (#4349)	2025-10-11 11:30:05 +08:00
freeliuzc	5035dd82ed	[MTP]support more branchs in topp kernel (#4353)	2025-10-11 11:27:35 +08:00
ltd0924	28aa18bfc1	[Feature] support prefix cache + dp (#4356) ... * fix * fix * fix * [Feature] support clear data * update * fix * fix * fix * fix * [BugFix] fix clear data * Update api_server.py * Update api_server.py * [Feature] support fd decode response * Update engine.py * Update envs.py * Update expert_service.py * Update common_engine.py * [Feature] support prefix cache + ep * fix * add * Update expert_service.py * Update common_engine.py * Update common_engine.py * Update common_engine.py * Update common_engine.py * Update common_engine.py --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Co-authored-by: ltd0924 <luotingdan@baidu.com>	2025-10-11 10:02:08 +08:00
Yuanle Liu	3c9eedd562	Simplify CUDAGraph creation logic (#4298) ... * Simplify CUDAGraph creation logic Refactor CUDAGraph initialization to always use unique memory pool if configured. * Conditionally import CUDAGraph based on CUDA compilation	2025-10-10 10:46:16 +08:00
Nyakku Shigure	fd5fd0bdd7	Remove redundant inplace outputs for append_attention (#4341)	2025-10-10 10:45:26 +08:00
Yuanle Liu	18f9c41370	Update paddleformers version to 0.1.6 (#4310)	2025-09-28 20:17:18 +08:00
ltd0924	c35a21a99a	[Feature] support fd return decode response (#4300) ... * fix * fix * fix * [Feature] support clear data * update * fix * fix * fix * fix * [BugFix] fix clear data * Update api_server.py * Update api_server.py * [Feature] support fd decode response * Update engine.py * Update envs.py * Update expert_service.py * Update common_engine.py --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Co-authored-by: ltd0924 <luotingdan@baidu.com>	2025-09-28 16:11:50 +08:00
freeliuzc	c8985727a6	support mtp in hybird-dp-tp mode (#4299)	2025-09-28 15:58:45 +08:00
GoldPancake	076c30cb0f	fix top_p_candidates and support separate setting of sampling params for mtp (#4189) ... * fix top_p_candidates * For separate setting params for mtp * delete print * fix	2025-09-28 11:41:20 +08:00
ltd0924	f8c6a354a1	[BUGFIX] clear request (#4286) ... * fix * fix * fix * [Feature] support clear data * update * fix * fix * fix * fix * [BugFix] fix clear data * Update api_server.py * Update api_server.py --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-09-27 14:08:48 +08:00
freeliuzc	b176cba474	support mtp in ep64 (#4280)	2025-09-26 15:38:03 +08:00
Yuanle Liu	dcf633c4d9	delete default value reasoning_max_tokens (#4250) ... * delete default value reasoning_max_tokens * Adjust max_tokens and reasoning_max_tokens logic	2025-09-26 10:42:27 +08:00
Zhong Hui	213f15ef55	fix ernie vl distributed attr. (#4259)	2025-09-25 20:06:29 +08:00
lizhenyun01	bab779011c	[CudaGraph] support cudagraph use shared pool (#4199) ... * support cudagraph use shared pool * add envs * change CUDAGRAPH_POOL_ID to int * change CUDAGRAPH_POOL_ID to use_memory_pool * unify use_unique_memory_pool * fix use_unique_memory_pool	2025-09-24 21:32:04 +08:00
freeliuzc	e2b68b33c9	fix mtp in rl (#4234)	2025-09-24 16:59:24 +08:00
Sunny-bot1	8a506500f3	[BugFix] Fix EP MoE prefill function (#4101)	2025-09-24 00:31:41 -07:00
ltd0924	1aab1c8d06	[BugFix] fix clear data (#4227) ... * [Feature] support adapter * fix * fix * fix * fix * fix * fix * [BugFix] fix clear data * Update api_server.py	2025-09-24 11:23:44 +08:00
freeliuzc	94b6e7a341	[MTP][RL]support rl reshard wenxin-tools-145 (#4173) ... * support mtp reshard in rl mode * fix function	2025-09-23 20:40:26 +08:00
Yuanle Liu	389c5dd3a2	Each module should have its own plugins_loaded (#4149)	2025-09-23 15:44:46 +08:00
Yuanle Liu	361104508e	support reasoning_max_tokens (#4207)	2025-09-23 15:44:41 +08:00
YuBaoku	0bfffdbc14	[CI] remove test_common_model (#4196)	2025-09-23 14:23:05 +08:00
ltd0924	f489c9f8ef	[Feature] support adapter (#4180) ... * [Feature] support adapter * fix * fix * fix * fix * fix * fix	2025-09-22 19:32:24 +08:00
lzy	be98f6e950	supports internode_ll_two_stage (#4143) ... * supports internode_ll_two_stage * supports internode_ll_two_stage * supports internode_ll_two_stage * supports internode_ll_two_stage	2025-09-22 14:55:06 +08:00
ltd0924	f75697c2d1	[Feature] support clear data (#4185) ... * fix * fix * fix * [Feature] support clear data * update * fix * fix * fix * fix	2025-09-21 20:41:27 +08:00
Yuan Xiaolan	1e86418c4a	optimize dy_cfp8's performance (#4145) ... Co-authored-by: carryyu <569782149@qq.com>	2025-09-19 09:35:28 +08:00
gaoziyuan	5027ed7239	【BugFif】fix ep decode (#4138) ... * suppoort expert num 3 pre rank * fix ep decode	2025-09-17 14:18:31 +08:00
Yuan Xiaolan	25aa2d94aa	cp dynamic Cfp8 (#4120) ... * supports dynamic Cfp8 * add unittest * fix dynamic Cfp8 computing error * fix Cfp8 for RL load --------- Co-authored-by: carryyu <569782149@qq.com>	2025-09-17 11:55:47 +08:00
gaoziyuan	b6caf6e622	suppoort expert num 3 pre rank (#4133)	2025-09-16 17:34:44 +08:00
Yuanle Liu	d381fa8194	fix reasoning parsers plugin (#4104)	2025-09-15 22:30:16 +08:00
freeliuzc	d2ab369427	[MTP]Support RL reshard (#4074) ... * support rl reshard * modify model name	2025-09-15 11:47:06 +08:00