4022 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jiaxin Sui	8e0f4dfd0c	[XPU] [CI] Xpu Ci Refactor (#5252) ... * add xpu ci * add case * add case * fix ci bug * Update Docker image tag to 'latest' in CI workflow * Fix set -e usage in run_xpu_ci_pytest.sh * add pd case * add case * Configure pip to use Tsinghua mirror for dependencies Set the global pip index URL to Tsinghua mirror. * fix ci bug * fix bug * fix bug --------- Co-authored-by: suijiaxin <suijiaxin@Suis-MacBook-Pro.local> Co-authored-by: root <root@gajl-bbc-onlinec-com-1511964.gajl.baidu.com> Co-authored-by: root <root@gajl-bbc-onlinec-com-1511972.gajl.baidu.com>	2025-12-02 17:15:51 +08:00
YuBaoku	6b03f4fb53	[CI] Update part of test_docker to paddle_dev (#5278)	2025-12-02 16:52:07 +08:00
YuBaoku	69e003abcb	[CI] Fix return_code check in test_chunked_moe.py (#5326)	2025-12-02 15:41:26 +08:00
qw86972190	6048ea37bd	[XPU]add enable_logprob (#5279) ... * [XPU]Update document * [XPU]Update documentation * [XPU]add enable_logprob * Fix code style issues * “doc” * “docs” * “doc” * Fix code style via pre-commit --------- Co-authored-by: root <root@gajl-bbc-onlinec-com-1498354.gajl.baidu.com>	2025-12-02 15:32:28 +08:00
lizexu123	c563eca791	[Feature] support reward model (#5301) ... * Your commit message here * add test * update develop * support reward * support enable_chunk_prefill * support bingfa * support convert is reward * update test * delete print * fix enable_thinking * add document * fix place * fix test * fix * support enable_prefix_caching * add no-enable_prefix-caching test * fix * support enable_prefix_caching * delete print * fix document * fix * fix test * fix document and delete chinese * udpate * enable_thinking * fix test	2025-12-02 14:55:31 +08:00
K11OntheBoat	2e1680838f	[PD Disaggregation] Support PD deployment of DeepSeekv3. (#5251) ... * Support deepseekv3 cache transfer for PD deploy * clean some log info --------- Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>	2025-12-02 14:11:50 +08:00
qwes5s5	117980dd4e	[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089) ... * add prompt logprobs * Merge prompt_logprobs_tensors and prompt_logprobs * fix param check * trigger ci * fix unitest * fix logprobs bug	2025-12-02 13:49:51 +08:00
YuanRisheng	af39819fcd	Revert "[CI] 【Hackathon 9th Sprint No.18】NO.18 功能模块单测补充 (#5064)" (#5290) ... This reverts commit 7bac016c77.	2025-12-02 13:43:36 +08:00
YuanRisheng	ded7765dec	Revert "[CI] 【Hackathon 9th Sprint No.41】NO.41 功能模块单测补充 (#5062)" (#5291) ... This reverts commit 373b5c3807.	2025-12-02 13:43:13 +08:00
YuBaoku	68533ebd95	[CI] disable test_chunked_moe.py in unit_test (#5322)	2025-12-02 10:39:50 +08:00
xiaolei373	84e2f6aa75	[CI]add clear to run-batch ci (#5307)	2025-12-01 21:18:19 +08:00
chen	aa35ce449d	[Optimization] EP empty_input_forward Remove Communication (#5254)	2025-12-01 21:10:40 +08:00
Jiaxin Sui	b0113cb0fc	[XPU][CI] Change XPU CI Base Value (#5318) ... * Add '小度' keyword to assertion in run_w4a8.py * Add keywords to assertion in run_ep_online.py * Add keywords to assertion in run_w4a8.py * Update run_45T.py * Update run_ep_online.py * Refactor assertion for response content keywords * Update run_w4a8.py * Update run_w4a8.py	2025-12-01 21:02:09 +08:00
cmcamdy	3149aed750	fix_gather_next_token (#5311)	2025-12-01 18:00:30 +08:00
Juncai	0925d44f18	[PD Disaggregation] support different tp_size for prefill and decode (#5296) ... * up * up * up * fix	2025-12-01 17:50:20 +08:00
Yuanle Liu	54119cf07e	[CI] Remove need approve by yuanlehome (#5310)	2025-12-01 01:44:43 -08:00
YuBaoku	cbbe6b892c	[CI] Update build_docker to paddle_manylinux (#5226)	2025-12-01 16:25:44 +08:00
Jiaxin Sui	b467e9dadc	[XPU][CI]Change W4A8 Case Base Value (#5309)	2025-12-01 15:25:33 +08:00
Longzhi Wang	add524d80c	[Feature] support chunked moe (#4575) ... * [Feature] support chunked moe * update * update * fix and add test * update * fix conflict and modity test * fix fused_moe * fix fused_moe * fix docstring * fix * fix typo * fix test * fix * fix * fix test * fix test	2025-12-01 15:17:18 +08:00
Jundong Liu	6f42c37359	[Deterministic] Move paddle version batch invariant pkg to Fastdeploy (#4763) ... * Move batch invariant pkg to Fastdeploy * fix problem and pre-commit * move test * Change testcase to FD style * Add testcase for log_softmax * Add testcase for mean * Add testcase for addmm * fix pre-commit * API check v0.9 * move to layers and add comment about log_softmax * Update fastdeploy/model_executor/layers/batch_invariant_ops/batch_invariant_ops.py 存在于原版代码注释中的版本控制遗留的内容，确实应该去除 Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/batch_invariant/test_batch_invariance_op_mean.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/batch_invariant/test_batch_invariance_op_logsoftmax.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/model_executor/layers/batch_invariant_ops/batch_invariant_ops.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * change comment after copilot fix * fix bug about addmm * avoid global effect by enable_torch_proxy --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-12-01 11:25:48 +08:00
ming1753	70ec1e17c1	[Features] add audio request & fix embedding bug (#5201) ... * [Features] add audio request & fix embedding bug * fix bug	2025-12-01 11:12:17 +08:00
cmcamdy	9f4977eb74	[xpu] support mtp for xpu(mix) (#5274) ... * [XPU] support kernel for mtp(base) * [XPU] support kernel for mtp(base) * format * format * format * fix gather next token * fix step && add test * fix * mv pre/post process * add adjust batch / gather next token for mtp * fix code style * fix mtp kenrel name * fix mtp kernel test * mv xpu pre/post process * mv xpu pre/post process * [xpu] support mtp * fix code style	2025-12-01 11:03:14 +08:00
kevin	8aec3acc8c	fix mm type bug (#5300)	2025-11-29 20:48:14 +08:00
kevin	048ca60013	fix aksk check bug	2025-11-29 09:14:28 +08:00
Divano	090a066e4a	[APIServer] add_prompt_ids_test (#5283) ... * add_prompt_ids_test * Update _base_test.yml * Update _base_test.yml * Update _base_test.yml * Update _base_test.yml	2025-11-29 08:31:31 +08:00
fmiao2372	2c7683d551	[Intel HPU] change MoE weights and scales from list to tensor and add… (#5289) ... * [Intel HPU] change MoE weights and scales from list to tensor and add q/k rms norm * update doc * move HPU_CHUNK_SIZE into envs	2025-11-28 19:17:05 +08:00
Zhang Yulong	5b49142988	update (#5298)	2025-11-28 18:29:16 +08:00
Yonghua Li	a535050b11	[FDConfig] remove engine client args, use fd_config instead (#5217) ... * [refactor] remove engine client args, use fd_config instead * [chore] update * [fix] fix * [fix] fix * [chore] rename config to fd_config * [fix] fix run_batch * [ci] add ci case for engine client --------- Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-11-28 01:20:54 -08:00
周周周	73886204d4	[Others] clean code (#5235)	2025-11-28 15:40:49 +08:00
kevin	2d69d91ab8	add aksk check (#5273)	2025-11-28 14:28:24 +08:00
K11OntheBoat	7bafcf1df3	[OP]Remove extra H2D in DeepGemm (#5262) ... Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>	2025-11-28 14:23:44 +08:00
周周周	95243f012c	[Others] add PADDLE_ENFORCE (#5288)	2025-11-28 14:23:35 +08:00
bukejiyu	1539fd6056	[BugFix]Set default OMP_NUM_THREADS=3 and fix extra GPU memory usage in DeepSeek (#5219) ... * fix bug * update * update * update * fix copy * update	2025-11-28 14:22:04 +08:00
Daci	7dc06cac6e	[BugFix] race condition [is_fetching] causing multiple fetch requests (#5238) ... * RouterArgs port str -> int * fix race condition [is_fetching] causing multiple fetch requests * bugfix: Delete duplicate input_ids tensor creation	2025-11-28 13:41:36 +08:00
Yuanle Liu	35479b691f	[BugFix] fix tsp o_proj bias add (#5284) ... * fix tsp bias add * fix * fix	2025-11-28 13:39:55 +08:00
Juncai	1a559c973f	Revert "[CI] 【Hackathon 9th Sprint No.33】NO.33 功能模块单测补充 (#5056)" (#5286) ... This reverts commit a12eaf9171.	2025-11-28 10:48:35 +08:00
ddchenhao66	fc88eebc32	[CI][XPU] add pd disaggregation (#5179) ... * [CI][XPU] add pd disaggregation * Clarify comments and install iproute2 Updated comments to clarify script purpose and added installation of iproute2. --------- Co-authored-by: ddchenhao66 <dhaochen163.com> Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-11-28 10:44:27 +08:00
lizhenyun01	aba4fc657f	[Feature] support flash_mask_attention backend (#5134) ... * [Feature] suppert flash_mask_attention backend * fix unittest * clean code	2025-11-28 10:12:16 +08:00
Divano	b935101008	Create test_prompt_ids.py	2025-11-28 10:11:51 +08:00
Jiaxin Sui	07cb11e51d	[XPU][CI] Set pip index URL to Tsinghua mirror (#5277) ... * Set pip index URL to Tsinghua mirror * Update ci_xpu.yml * Update Docker image version in CI workflow * Update Docker image tag in CI workflow	2025-11-27 22:12:20 +08:00
YuBaoku	6a6bf4ea24	[CI] Fix test streaming with stop str (#5275) ... * [CI] add output for last_token in test_streaming_with_stop_str * [CI] Adapt empty last_token check	2025-11-27 20:51:39 +08:00
chen	35f85baf09	[BugFix]fix v1 loader lm head fp32 (#5270)	2025-11-27 20:12:56 +08:00
xiaolei373	b52ec268f7	[CI]fix run batch unit test (#4628)	2025-11-27 19:38:04 +08:00
YuBaoku	1372d6d01d	[CI] disable test_engine_client.py unit test (#5272)	2025-11-27 17:37:54 +08:00
CSWYF3634076	051b82b4c8	[Docs] add qwen25-vl docs (#5243) ... * [Docs] add qwen25-vl docs * [Docs] add qwen25-vl docs * [Docs] add qwen25-vl docs	2025-11-27 15:05:57 +08:00
cmcamdy	5a67a6d960	[XPU] support kernel for mtp(base) (#4748) ... * [XPU] support kernel for mtp(base) * [XPU] support kernel for mtp(base) * format * format * format * fix gather next token * fix step && add test * fix * mv pre/post process * add adjust batch / gather next token for mtp * fix code style * fix mtp kenrel name * fix mtp kernel test * mv xpu pre/post process * mv xpu pre/post process	2025-11-27 15:05:44 +08:00
fl0w2o48	e63d715fc3	[BugFix][Metrics] Fix Prometheus Multiprocess Metrics Issues and Add ZMQ Communication Metrics (#5185) ... * [Feature] add metrics for ZMQ and fix multiprocess metrics * fix test_metrics.py --------- Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-11-27 15:05:09 +08:00
Juncai	ce9a49f6bf	[PD Disaggregation] Add unittest for splitwise deployment with using rdma (#5189) ... * Add splitwise deployment with using rdma * clean cuda	2025-11-27 14:27:17 +08:00
xunyoyo	373b5c3807	[CI] 【Hackathon 9th Sprint No.41】NO.41 功能模块单测补充 (#5062) ... * Add tests for SplitwiseConnector functionality This commit introduces a comprehensive test suite for the SplitwiseConnector class, implementing various tests to ensure the correct functionality of task dispatching, message sending, and connection handling. The tests cover scenarios for both prefill and decode roles, including checks for task promotion, message serialization, and error handling. * Add innode splitwise test helpers * Refine Splitwise connector test stubs * Add to_tensor stub for splitwise tests * Update splitwise connector tests	2025-11-27 14:24:19 +08:00
Yuanle Liu	ef5aa5c03b	[BugFix] fix cuda-python requirement (#5261) ... * fix cuda-python requirement * update * fix	2025-11-27 13:58:18 +08:00