30 Commits

Author	SHA1	Message	Date
yyssys	6bfa4fed6e	[Docs]Update XPU document version to 2.3.0 (#4754) ... * [Docs]Update XPU document version to 2.3.0 * update	2025-11-03 13:36:12 +08:00
kxz2002	24b85b752b	[Cherry-Pick] Unify the registration name recognition for tool_parser and reasoning_parser to “-” (#4668) (#4737) ... * [Feature] add a new reasoning parser (#4571) * add new reasoning_parser initial commit * add parser file content * add register * ernie_test_reasoning_parser * support <tool_call> token and add tool_parser * add and fix unit tests * modify reasoning_parser * modify reasoning parser and tool parser * modify unit tests * modify reasoning_parser and tool_parser * modify unit tests * fix tool_parser * modify the logic of reasoning_parser and tool_parser * add and modify unit tests * standardize code style * simplify reasoning_parser and tool_parser * modify unit test * [BugFix] Fix finish reason in _create_chat_completion_choice (#4582) * fix n_param _create_chat_completion_choicel * fix unit test * fix final_res * modify unit tests * [BugFix] fix offline llm chat "enable_thinking" is always "False" (#4686) * fix enable_thinking * recover ernie4_5_vl_processor * [Feature] Unify the registration name recognition for tool_parser and reasoning_parser to “-” (#4668) * parser register name unify * change ernie_x1 to ernie-x1 * change ernie4_5_vl to ernie-45-vl * fix unit test	2025-10-31 23:27:21 +08:00
ming1753	7681375a19	[BugFix] PaddleOCR-VL fix FD_DEBUG type and support v1 loader (#4605) ... * [Bug Fix] PaddleOCRVL fix FD_DEBUG type and support HF model * fix bug * fix bug * fix bug	2025-10-28 09:47:47 +08:00
ddchenhao66	c91c5040c4	[XPU] update kunlun doc about supported models (#4586) ... Co-authored-by: ddchenhao66 <dhaochen163.com>	2025-10-27 18:31:51 +08:00
kevin	8aab4e367f	[Feature] mm support prefix cache (#4134) ... * support mm prefix caching * update code * fix mm_hashes * support encoder cache * add encoder cache * update code * update encoder cache * fix features bug * fix worker bug * support processor cache, need to optimize yet * refactor multimodal data cache * update code * update code * update v1 scheduler * update code * update code * update codestyle * support turn off processor cache and encoder cache * update pre-commit * fix code * solve review * update code * update code * update test case * set processor cache in GiB * update test case * support mm prefix caching for qwen model * fix code style check * update pre-commit * fix unit test * fix unit test * add ci test case * fix rescheduled bug * change text_after_process to prompt_tokens * fix unit test * fix chat template * change model path * [EP] fix adapter bugs (#4572) * Update expert_service.py * Update common_engine.py * Update expert_service.py * fix v1 hang bug (#4573) * fix import image_ops error on some platforms (#4559) * [CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558) * add collect-env * del files * [Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578) * add new branch for sot * reorder * fix batch bug * [XPU]Moe uses a new operator (#4585) * [XPU]Moe uses a new operator * [XPU]Moe uses a new operator * update response * [Feature] Support Paddle-OCR (#4396) * init * update code * fix code style & disable thinking * adapt for common_engine.update_mm_requests_chunk_size * use 3d rope * use flash_attn_unpadded * opt siglip * update to be compatible with the latest codebase * fix typo * optim OCR performance * fix bug * fix bug * fix bug * fix bug * normlize name * modify xpu rope * revert logger * fix bug * fix bug * fix bug * support default_v1 * optim performance * fix bug --------- Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com> * [DataProcessor] add reasoning_tokens into usage info (#4520) * add reasoning_tokens into usage info initial commit * add unit tests * modify unit test * modify and add unit tests * fix unit test * move steam usage to processor * modify processor * modify test_logprobs * modify test_logprobs.py * modify stream reasoning tokens accumulation * fix unit test * perf: Optimize task queue communication from engine to worker (#4531) * perf: Optimize task queue communication from engine to worker * perf: get_tasks to numpy * perf: get_tasks remove to_numpy * fix: request & replace ENV * remove test_e2w_perf.py * fix code style --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> * Clean up ports after processing results (#4587) * [CI] Add /re-run command in PR comments to restart failed CI workflows (#4593) * [Others] api server exits when worker process is dead (#3271) * [fix] fix terminal hangs when worker process is dead * [chore] change sleep time of monitor * [chore] remove redundant comments * update docs --------- Co-authored-by: ApplEOFDiscord <wwy640130@163.com> Co-authored-by: ApplEOFDiscord <31272106+ApplEOFDiscord@users.noreply.github.com> Co-authored-by: ltd0924 <32387785+ltd0924@users.noreply.github.com> Co-authored-by: yinwei <yinwei_hust@163.com> Co-authored-by: JYChen <zoooo0820@qq.com> Co-authored-by: qwes5s5 <45442318+qwes5s5@users.noreply.github.com> Co-authored-by: Ryan <zihaohuang@aliyun.com> Co-authored-by: yyssys <atyangshuang@foxmail.com> Co-authored-by: ming1753 <61511741+ming1753@users.noreply.github.com> Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com> Co-authored-by: kxz2002 <115912648+kxz2002@users.noreply.github.com> Co-authored-by: SunLei <sunlei5788@gmail.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Co-authored-by: Zhang Yulong <35552275+ZhangYulongg@users.noreply.github.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com> Co-authored-by: 李泳桦 <39643373+liyonghua0910@users.noreply.github.com>	2025-10-27 17:39:51 +08:00
Sunny-bot1	4ffe41a747	WINT4/WINT8 dense gemm default use Machete (#4451)	2025-10-23 17:57:59 +08:00
Yuanle Liu	cef3164c3b	Optimizing the performance of think length limit using custom operators (#4279) ... * delete impl * delete min_length&max_length * support limit thinking content strategy * fix * fix * fix * update * fix set_value_by_flags_and_idx * fix * fix * fix * fix * update * fix * fix * fix typo * fix ci * fix * fix * support mtp * fix * fix * update * update	2025-10-20 21:09:13 +08:00
yangjianfengo1	329d074326	[Docx] fix the broken link (#4479) ... * 修改文档 * 修改文档	2025-10-17 18:28:50 +08:00
yangjianfengo1	ba5c2b7e37	[Docx] add language (en/cn) switch links (#4470) ... * add install docs * 修改文档 * 修改文档	2025-10-17 15:47:41 +08:00
xiaolei373	720697e265	add environment variables (#4466)	2025-10-17 14:20:01 +08:00
yyssys	584d116889	[Doc] fix document navigation link paths (#4368)	2025-10-13 11:01:35 +08:00
yyssys	f40d7c6d65	[Docs]When XPU starts the service, the model loader uses the default version (#4292)	2025-09-26 15:58:12 +08:00
yyssys	c415885a94	[Docs]Add ENABLE_V1_KVCACHE_SCHEDULER=0 to docs (#4268)	2025-09-25 20:09:03 +08:00
bukejiyu	2650f58740	[docs] Update environment variables documentation (#3957)	2025-09-10 21:17:06 -07:00
Sunny-bot1	ed5133f704	update env docs for Machete (#3959)	2025-09-08 14:44:31 +08:00
Jiang-Jia-Jun	27f2e7a6f1	Create faq.md	2025-09-02 11:07:37 +08:00
co63oc	d6369b4d51	fix typos (#3684)	2025-09-01 17:50:17 +08:00
周周周	17b414c2df	MoE Default use triton's blockwise fp8 in TP Case (#3678)	2025-08-29 11:07:30 +08:00
Mattheliu	108d989d9d	[Docs] add fastdeploy_unit_test_guide.md (#3484) ... * docs:add fastdeploy_unit_test_guide.md * docs:fix fastdeploy_unit_test_guide.md * docs: add FastDeploy unit test spec (EN) and update usage nav * fix codestyle	2025-08-28 14:12:25 +08:00
yinwei	354575b6d1	[Docs]Modify the gpu-memory-utilization of the 128K 8-card Wint4 model to 0.95 (#3428) ... * XPU Update 2.1 Release Documentation * code style check * Modify the gpu-memory-utilization of the 128K 8-card Wint4 model to 0.95	2025-08-15 18:34:37 +08:00
yinwei	fbb6dcb9e4	[Docs]XPU Update 2.1 Release Documentation (#3423) ... * XPU Update 2.1 Release Documentation * code style check	2025-08-15 14:07:47 +08:00
Yuanle Liu	9571c458f0	enhance eos_tokens (#3274) ... * enhance eos_tokens * update * update	2025-08-11 14:47:52 +08:00
hong19860320	93a1731891	[Doc] Update deps and fix dead links (#3252)	2025-08-07 11:04:31 +08:00
yinwei	5b9aec1f10	xpu release 2.0.3 (#3105)	2025-07-31 14:26:07 +08:00
Zero Rains	25698d56d1	polish code with new pre-commit rule (#2923)	2025-07-19 23:19:27 +08:00
yulangz	7dfd2ea052	[XPU][doc] Update minimal fastdeploy required (#2863) ... * [XPU][doc] update minimal fastdeploy required	2025-07-17 11:33:22 +08:00
yulangz	17314ee126	[XPU] Update doc and add scripts for downloading dependencies (#2845) ... * [XPU] update xvllm download * update supported models * fix xpu model runner in huge memory with small model * update doc	2025-07-16 11:05:56 +08:00
Sunny-bot1	240d6236bc	[Fix]fix top_k_top_p sampling (#2801) ... * fix topk-topp * update * add base_non_truncated	2025-07-10 22:35:10 +08:00
chen	888780ffde	[Feature] block_wise_fp8 support triton_moe_backend (#2767)	2025-07-09 19:22:47 +08:00
Jiang-Jia-Jun	92c2cfa2e7	Sync v2.0 version of code to github repo	2025-06-29 23:29:37 +00:00