3633 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Yuanle Liu	20756cd2bb	fix import jit.marker.unified (#4622)	2025-10-28 22:11:03 +08:00
ming1753	561b9f38d3	[BugFix] fix paddleocr prefix cache bug (#4625) ... * fix paddleocr prefix cache bug * disable prefix-caching in ocr	2025-10-28 21:38:12 +08:00
RAM	fff5fb5e39	[Graph Optimization] Refactor default capture list (#4617) ... * fix bug and refine code * add debug count * refine code	2025-10-28 21:31:02 +08:00
Lucas	0a0c74e717	[XPU] Support PaddleOCR-VL model for XPU (#4529) ... * [XPU] support PaddleOCR-VL in XPU * [XPU] fix PaddleOCR-VL pos_emb_type	2025-10-28 20:35:04 +08:00
SunLei	2a9ed72533	feat: add support for API usage with multimodal models (#4548) ... * feat: add support for API usage with multimodal models * completion_tokens contains num_image_tokens * remove test_request.py * fix: paddle.device.is_compiled_with_cuda() * fix test_unstream_without_logprobs	2025-10-28 20:23:46 +08:00
YuBaoku	e1ac90d787	[CI] Revert test_rollout_model directory change (#4626)	2025-10-28 20:14:00 +08:00
zhouchong	567f61072c	[CI][BugFix] fix port conflicts in concurrent ci test and add more unit test on async_llm (#4616) ... * fix:port conflicts in concurrent ci test * add more unit test on async_llm	2025-10-28 19:04:24 +08:00
yyssys	cd6d1f633c	[XPU]add xpu ci w4a8 case (#4501)	2025-10-28 19:02:29 +08:00
Ryan	07956a87b3	[Graph Optimization] Fix IR graph dependency error exposed after enabling SOT by updating the return value of TextImageGatherScatter (#4610) ... * fix TextImageGatherScatter in sot * fix codestyle	2025-10-28 18:31:23 +08:00
lizhenyun01	4d2f478d53	[BugFix] fix TPDP mix parallel infer (#4583) ... Co-authored-by: Yuanle Liu <yuanlehome@163.com>	2025-10-28 16:58:20 +08:00
freeliuzc	c63361fd1d	[Speculative Decoding][MTP]Support mtp in epdptp mode (#4614) ... * support mtp many features * support mtp reshard in rl mode * fix function * support mtp ep * support mtp in hybird-dp-tp mode * default open scheduler_v1 in mtp	2025-10-28 16:02:47 +08:00
Zhang Yulong	b4014834a9	Extend sleep time to 10 seconds in switch_service (#4618) ... Increase sleep duration before switching services.	2025-10-28 15:19:21 +08:00
RAM	86d5006a57	[Graph Optimization][Speculative Decoding] Update yaml and fix typo (#4612)	2025-10-28 11:43:26 +08:00
YuBaoku	b2c6c41447	[CI] Relocate server test cases from ci_use directory to e2e (#4608)	2025-10-28 11:37:30 +08:00
xiaolei373	31180a6a13	fix_run_batch_unittest (#4613)	2025-10-28 10:38:06 +08:00
xiaolei373	0b196d82f3	[docs] add cli uasge to docs (#4569)	2025-10-28 10:35:11 +08:00
Daci	6426414a0f	[Feature] EngineWorkerQueue anonymous port (#4597) ... * EngineWorkerQueue 支持匿名端口设置 * EngineWorkerQueue 支持匿名端口设置 * EngineWorkerQueue 支持匿名端口设置 * EngineWorkerQueue 支持匿名端口设置 * EngineWorkerQueue 支持匿名端口设置	2025-10-28 10:22:37 +08:00
ming1753	7681375a19	[BugFix] PaddleOCR-VL fix FD_DEBUG type and support v1 loader (#4605) ... * [Bug Fix] PaddleOCRVL fix FD_DEBUG type and support HF model * fix bug * fix bug * fix bug	2025-10-28 09:47:47 +08:00
zhouchong	6dcf5a3e87	fix: resolve decode bug in offline stream output (#4603)	2025-10-27 20:17:10 +08:00
周周周	3729e910a6	remove dev sync in prefill (#4598)	2025-10-27 19:54:43 +08:00
K11OntheBoat	64d1aa973b	[Unitest]Add unitest of Attention Layer (#4494)	2025-10-27 19:18:50 +08:00
ophilia-lee	70aa7423f8	benchmark工具适配SGLang框架 (#4607) ... * benchmark工具适配SGLang框架 * benchmark工具适配SGLang框架 * benchmark工具适配SGLang框架	2025-10-27 18:52:56 +08:00
ddchenhao66	c91c5040c4	[XPU] update kunlun doc about supported models (#4586) ... Co-authored-by: ddchenhao66 <dhaochen163.com>	2025-10-27 18:31:51 +08:00
RAM	25a983ba9c	1.fix the bug of draft model with ep 2.fix sampler bug (#4589)	2025-10-27 17:47:34 +08:00
kevin	8aab4e367f	[Feature] mm support prefix cache (#4134) ... * support mm prefix caching * update code * fix mm_hashes * support encoder cache * add encoder cache * update code * update encoder cache * fix features bug * fix worker bug * support processor cache, need to optimize yet * refactor multimodal data cache * update code * update code * update v1 scheduler * update code * update code * update codestyle * support turn off processor cache and encoder cache * update pre-commit * fix code * solve review * update code * update code * update test case * set processor cache in GiB * update test case * support mm prefix caching for qwen model * fix code style check * update pre-commit * fix unit test * fix unit test * add ci test case * fix rescheduled bug * change text_after_process to prompt_tokens * fix unit test * fix chat template * change model path * [EP] fix adapter bugs (#4572) * Update expert_service.py * Update common_engine.py * Update expert_service.py * fix v1 hang bug (#4573) * fix import image_ops error on some platforms (#4559) * [CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558) * add collect-env * del files * [Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578) * add new branch for sot * reorder * fix batch bug * [XPU]Moe uses a new operator (#4585) * [XPU]Moe uses a new operator * [XPU]Moe uses a new operator * update response * [Feature] Support Paddle-OCR (#4396) * init * update code * fix code style & disable thinking * adapt for common_engine.update_mm_requests_chunk_size * use 3d rope * use flash_attn_unpadded * opt siglip * update to be compatible with the latest codebase * fix typo * optim OCR performance * fix bug * fix bug * fix bug * fix bug * normlize name * modify xpu rope * revert logger * fix bug * fix bug * fix bug * support default_v1 * optim performance * fix bug --------- Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com> * [DataProcessor] add reasoning_tokens into usage info (#4520) * add reasoning_tokens into usage info initial commit * add unit tests * modify unit test * modify and add unit tests * fix unit test * move steam usage to processor * modify processor * modify test_logprobs * modify test_logprobs.py * modify stream reasoning tokens accumulation * fix unit test * perf: Optimize task queue communication from engine to worker (#4531) * perf: Optimize task queue communication from engine to worker * perf: get_tasks to numpy * perf: get_tasks remove to_numpy * fix: request & replace ENV * remove test_e2w_perf.py * fix code style --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> * Clean up ports after processing results (#4587) * [CI] Add /re-run command in PR comments to restart failed CI workflows (#4593) * [Others] api server exits when worker process is dead (#3271) * [fix] fix terminal hangs when worker process is dead * [chore] change sleep time of monitor * [chore] remove redundant comments * update docs --------- Co-authored-by: ApplEOFDiscord <wwy640130@163.com> Co-authored-by: ApplEOFDiscord <31272106+ApplEOFDiscord@users.noreply.github.com> Co-authored-by: ltd0924 <32387785+ltd0924@users.noreply.github.com> Co-authored-by: yinwei <yinwei_hust@163.com> Co-authored-by: JYChen <zoooo0820@qq.com> Co-authored-by: qwes5s5 <45442318+qwes5s5@users.noreply.github.com> Co-authored-by: Ryan <zihaohuang@aliyun.com> Co-authored-by: yyssys <atyangshuang@foxmail.com> Co-authored-by: ming1753 <61511741+ming1753@users.noreply.github.com> Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com> Co-authored-by: kxz2002 <115912648+kxz2002@users.noreply.github.com> Co-authored-by: SunLei <sunlei5788@gmail.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Co-authored-by: Zhang Yulong <35552275+ZhangYulongg@users.noreply.github.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com> Co-authored-by: 李泳桦 <39643373+liyonghua0910@users.noreply.github.com>	2025-10-27 17:39:51 +08:00
YuBaoku	a4fb3d4ff0	[CI] Fix path error of /re-run (#4606) ... * [CI] Add /re-run command in PR comments to restart failed CI workflows * [CI] Fix /re-run command	2025-10-27 17:03:11 +08:00
chen	5c63a089f6	[Feature] Support logprobs_mode (#4567)	2025-10-27 14:27:48 +08:00
CSWYF3634076	acd331780c	[V1 loader] Qwen25 VL support v1 loader and torch style safetensors load (#4388) ... * [BugFix] qwen2.5vl enable_thinking=true and image_patch_id bug fix * [Docs]offine infer add apply_chat_template add_generation_prompt parameter * [Model]qwen2.5VL support --use-cudagraph * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v2 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v3 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v4 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v5 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v6 * [Model]qwen2.5VL support --use-cudagraph buffer and qwenvl test v7 * qwen25vl v1 loader * qwen25vl v1 loader v2 * qwen25vl v1 loader v3 * qwen25vl v1 loader fix tp2 weight PySafeSlice * qwen25vl v1 loader no test * qwen25vl v1 loader add unit test * qwen25vl v1 loader add unit test v2 * qwen25vl v1 loader add torch unit test v3 * qwen25vl v1 loader add torch unit test v4 * qwen25vl v1 loader add torch unit test v5 * qwen25vl v1 loader add torch unit test v6	2025-10-27 10:54:15 +08:00
Lucas	5c6105f4a2	[XPU] bind some OPs for VL model with pybind (#4522)	2025-10-27 10:50:08 +08:00
李泳桦	cdc40cdc2a	[Others] api server exits when worker process is dead (#3271) ... * [fix] fix terminal hangs when worker process is dead * [chore] change sleep time of monitor * [chore] remove redundant comments	2025-10-27 10:23:48 +08:00
YuBaoku	ebae69b1f8	[CI] Add /re-run command in PR comments to restart failed CI workflows (#4593)	2025-10-27 10:18:56 +08:00
Zhang Yulong	83b720804b	Clean up ports after processing results (#4587)	2025-10-27 10:13:24 +08:00
SunLei	dc1a9c7287	perf: Optimize task queue communication from engine to worker (#4531) ... * perf: Optimize task queue communication from engine to worker * perf: get_tasks to numpy * perf: get_tasks remove to_numpy * fix: request & replace ENV * remove test_e2w_perf.py * fix code style --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-10-25 22:45:38 +08:00
kxz2002	327fa4c255	[DataProcessor] add reasoning_tokens into usage info (#4520) ... * add reasoning_tokens into usage info initial commit * add unit tests * modify unit test * modify and add unit tests * fix unit test * move steam usage to processor * modify processor * modify test_logprobs * modify test_logprobs.py * modify stream reasoning tokens accumulation * fix unit test	2025-10-25 16:57:58 +08:00
ming1753	e4e3cede7f	[Feature] Support Paddle-OCR (#4396) ... * init * update code * fix code style & disable thinking * adapt for common_engine.update_mm_requests_chunk_size * use 3d rope * use flash_attn_unpadded * opt siglip * update to be compatible with the latest codebase * fix typo * optim OCR performance * fix bug * fix bug * fix bug * fix bug * normlize name * modify xpu rope * revert logger * fix bug * fix bug * fix bug * support default_v1 * optim performance * fix bug --------- Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com>	2025-10-24 23:34:30 +08:00
yyssys	822dea8d5f	[XPU]Moe uses a new operator (#4585) ... * [XPU]Moe uses a new operator * [XPU]Moe uses a new operator * update response	2025-10-24 23:01:46 +08:00
Ryan	f42ed6d5f2	[Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578) ... * add new branch for sot * reorder * fix batch bug	2025-10-24 18:36:52 +08:00
qwes5s5	e02a812880	[CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558) ... * add collect-env * del files	2025-10-24 16:46:45 +08:00
JYChen	83d45af1f3	fix import image_ops error on some platforms (#4559)	2025-10-24 16:09:20 +08:00
yinwei	5fbc653238	fix v1 hang bug (#4573)	2025-10-24 15:35:10 +08:00
ltd0924	b60ce4922b	[EP] fix adapter bugs (#4572) ... * Update expert_service.py * Update common_engine.py * Update expert_service.py	2025-10-24 12:30:08 +08:00
李泳桦	8edc5cca91	[BugFix] fix create_cache_tensor for ep (#4542) ... * [fix] fix create_cache_tensor for ep * [fix] fix again	2025-10-24 11:31:13 +08:00
xiaozude	f7069b8057	[Metax] adapt DeepSeek (#4498)	2025-10-24 10:14:53 +08:00
Sunny-bot1	8718fa34b2	support static C8 (#4568)	2025-10-23 22:01:03 +08:00
RAM	e36343d807	[FDConfig]Turn on the CUDAGraph + PD Disaggregation switch (#4530)	2025-10-23 21:05:14 +08:00
RAM	9dc5c3e370	[Graph Optimization] Support CUDAGraph Padding + MTP (#4545) ... * Support CUDAGraph Padding + MTP * support orther write cache kernel	2025-10-23 20:57:26 +08:00
RichardWooSJTU	5a8c60454e	[BugFix] Fix decode_type which has been deleted in req and optimize token client retry scheme (#4564)	2025-10-23 05:08:10 -07:00
zhupengyang	3a43dbf82d	[XPU] merge apply_tp, ops support token_num = 0 (#4507)	2025-10-23 19:09:58 +08:00
Sunny-bot1	4ffe41a747	WINT4/WINT8 dense gemm default use Machete (#4451)	2025-10-23 17:57:59 +08:00
YuBaoku	a240425db9	[CI] Optimize coverage upload reporting (#4547) ... * [CI] Optimize coverage upload reporting * [CI] fix upload reporting * [CI] fix code style	2025-10-23 17:01:48 +08:00