3882 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Daci	eab8384da6	[Feature] ThreadPoolExecutor async fill_token_bitmask (#5083) ... * ThreadPoolExecutor async fill_token_bitmask * ThreadPoolExecutor async fill_token_bitmask logging * fix test_guided_decoding * Apply suggestions from code review Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * add fill_bitmask_parallel_batch_size ENV * FD_FILL_BITMASK_BATCH fastdeploy.envs --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-11-19 10:04:16 +08:00
K11OntheBoat	4a7739ec0b	Fix dummy run when use PD Disaggregation with EP inference. (#5112) ... Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>	2025-11-18 21:09:30 +08:00
plusNew001	7fdc920a01	[HPU][CI]Update Docker image in CI workflow (#5108)	2025-11-18 20:43:19 +08:00
kxz2002	97189079b9	[BugFix] unify max_tokens (#4968) ... * unify max tokens * modify and add unit test * modify and add unit test * modify and add unit tests --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-11-18 20:01:33 +08:00
xiaolei373	3d7f1a843e	[Docs]fix_cli_docs (#5109)	2025-11-18 17:56:12 +08:00
周周周	6584ee90e8	[unitest]clean code (#5094)	2025-11-18 17:21:35 +08:00
lizhenyun01	d11235333e	format flash_mask_attn	2025-11-18 17:18:12 +08:00
lizhenyun01	cd2c4df64a	format flash_mask_attn	2025-11-18 17:18:12 +08:00
YuBaoku	d0b3bec585	Revert "[CI] Temporarily lock paddlepaddle-gpu as of 20251112 (#5017)" (#5098) ... This reverts commit 91d34c2e35.	2025-11-18 14:17:09 +08:00
yzwu	d5d0602859	[Iluvatar][CI] disable compiling cudaLaunch API (#5100)	2025-11-18 14:15:31 +08:00
MingkunZhang	a36c958c66	[Metax] support default_v1 loader based #4988 (#5001)	2025-11-18 09:44:30 +08:00
YuBaoku	5d7516dc8c	[CI] Enable check_pr_template in CI rerun (#5093) ... * [CI] Drop checklist section in PR template check * [CI] Enable check_pr_template in CI rerun	2025-11-17 22:34:38 +08:00
Echo-Nie	abc9fd31c7	【Hackathon 9th No.76】supplementary unit test for XGrammarChecker (#4075) ... * supplementary unit test for XGrammarChecker * mock the xgrammer,torch	2025-11-17 22:05:53 +08:00
chen	d58c1db8a0	[Feature][OP] Append Attn Support CUDA-PDL (#5072)	2025-11-17 20:47:33 +08:00
FocusLuo	c2c1942db9	[INTEL_HPU] [CI] enabled fastdeploy PR testing (#4596) ... * [INTEL HPU] added hpu ci work flow support Signed-off-by: Luo, Focus <focus.luo@intel.com> * [INTEL HPU] added run ci hpu test scripts Signed-off-by: Luo, Focus <focus.luo@intel.com> * [INTEL HPU] enabled HPU ernie test case Signed-off-by: Luo, Focus <focus.luo@intel.com> * [INTEL HPU] updated Intel Gaudi Readme with Warmup disable cmdline Signed-off-by: Luo, Focus <focus.luo@intel.com> * Modify paddlepaddle installation command Updated paddlepaddle installation command to use a specific index URL. * Update run_ci_hpu.sh * Rename json directory to nlohmann_json Rename extracted json directory to nlohmann_json. * Update ci_hpu.yml * Set pip global index URL to Tsinghua mirror * Update CI workflow to use self-hosted runner and paths * Update Docker image in CI workflow * Modify HPU installation URLs in run_ci_hpu.sh Updated the installation URL for paddle_intel_hpu and added paddlenlp_ops installation. * Fix paddle_intel_hpu installation URL Corrected the URL for paddle_intel_hpu wheel installation. --------- Signed-off-by: Luo, Focus <focus.luo@intel.com> Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-17 19:24:41 +08:00
周周周	b23e684b67	revert group size 3 (#5079)	2025-11-17 18:54:13 +08:00
SunLei	d9f64adb0e	fix: Fix block allocation issue when MTP and logprobs are enabled (#5077)	2025-11-17 17:50:07 +08:00
Sunny-bot1	8a4ddb29df	Revert "[BugFix] Revert skip capture (#5023)" (#5080)	2025-11-17 16:14:55 +08:00
plusNew001	7f94d77e08	[XPU][CI] fix ci case bug (#5084) ... * Ignore markdown and text files in CI workflow * Change GPU_ID to XPU_ID in run_ci_xpu.sh * Change GPU_ID to XPU_ID in test configuration * Change GPU_ID to XPU_ID for service port calculation * Change GPU_ID to XPU_ID for device identification * Change GPU_ID to XPU_ID in test_ep function * Update run_w4a8.py * Redirect stop_processes output to kill.log Redirect output of stop_processes to kill.log to capture logs. * Log server output for failed test cases Added logging of server.log for failed tests. * Add '-s' option to pytest commands in run_ci_xpu.sh * Refactor assertion to validate multiple keywords Updated assertion to check for multiple keywords in response. * Fix assertany to assert any in run_45vl.py	2025-11-17 16:01:27 +08:00
fmiao2372	74f33efdbf	[Intel HPU] fix bugs caused by other commits (#5074) ... * [Intel HPU] fix bugs caused by other commits * update code by copilot	2025-11-17 15:28:55 +08:00
LiqinruiG	33f96ff93a	[BugFix] rollback max_tokens and min_tokens when continue to infer (#5052) ... Co-authored-by: liqinrui <liqinrui@baidu.com>	2025-11-17 14:31:26 +08:00
Winters Montagne	ff26158f20	Add unit tests for triton_utils_v2 (#5073)	2025-11-17 11:46:38 +08:00
megemini	c35e540c18	【Hackathon 9th No.109】[CppExtension] Support build Custom OP in setuptools 80+ (#4977) ... * 添加对现代Python打包方法的兼容性支持 * [CppExtension] 优化构建脚本逻辑并更新.gitignore	2025-11-17 11:46:27 +08:00
Winters Montagne	02c83d65db	[CI]【Hackathon 9th Sprint No.13】NO.13 功能模块 fastdeploy/model_executor/ops/triton_ops/triton_utils.py 单测补充 (#5035) ... * Add unit tests for triton_utils.py * update name * update * update * update	2025-11-17 11:43:31 +08:00
qwes5s5	36216e62f0	[Log] Add trace log and add loggingInstrumentor tool (#4692) ... * add trace logger and trace print * trigger ci * fix unittest * translate notes and add copyright --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-11-17 11:08:57 +08:00
zhouchong	5444af6ff6	[APIServer] metrics use port the same as api_port (#5016) ... * metrics use port the same as api_port * Be tolerant to tests that monkeypatch/partially mock args. * Reduce code redundancy --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-11-17 10:42:45 +08:00
xiaozude	68f638f8b9	[Metax] support default_v1 loader and quant_config is None for triton moe (#5030)	2025-11-17 10:38:00 +08:00
yangjianfengo1	3afb717995	【Fix】fix deepep dispatch (#5036) ... * fix dispatch * fix dispatch --------- Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com>	2025-11-17 10:34:01 +08:00
yzwu	3b80a799ab	[Iluvatar][CI] Fix moe_expert_dispatch cannot support dequant_scale (#5012) ... Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-11-17 10:18:42 +08:00
fmiao2372	e43a5fc055	[Intel HPU] enable level 1 prefix caching and fix some bugs (#4971) ... * [Intel HPU] enable prefix caching and dense tp moe ep and fix some bugs * update code by copilot * remove dense tp and moe ep code	2025-11-14 19:42:50 +08:00
plusNew001	0e819cd596	[CI][XPU] Optimize CI logs and variable names (#5025) ... * Ignore markdown and text files in CI workflow * Change GPU_ID to XPU_ID in run_ci_xpu.sh * Change GPU_ID to XPU_ID in test configuration * Change GPU_ID to XPU_ID for service port calculation * Change GPU_ID to XPU_ID for device identification * Change GPU_ID to XPU_ID in test_ep function * Update run_w4a8.py * Redirect stop_processes output to kill.log Redirect output of stop_processes to kill.log to capture logs. * Log server output for failed test cases Added logging of server.log for failed tests. * Add '-s' option to pytest commands in run_ci_xpu.sh	2025-11-14 19:35:35 +08:00
Jiang-Jia-Jun	d41cf643f8	Update nvidia_gpu.md	2025-11-14 18:26:08 +08:00
Jiang-Jia-Jun	692d69229b	Update nvidia_gpu.md	2025-11-14 18:17:32 +08:00
Daci	5fc12eddfe	[Optimization] xgrammar async compile, multi thread, speed up (#4835) ... * xgrammar async compile, multi thread, speed up * fix test_sampler.py & pre-commit err * add redis version check && fix request.llm_engine_recv_req_timestamp * xgrammar prefill & decode & v0 * fix test_gpu_prompt_logprobs.py * add test_guided_decoding.py * Update fastdeploy/scheduler/splitwise_scheduler.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/model_executor/guided_decoding/xgrammar_backend.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/model_executor/guided_decoding/xgrammar_backend.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix torch xgrammar unittest env --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-11-14 18:05:26 +08:00
Winters Montagne	b925533051	add test_process_video.py (#5011)	2025-11-14 17:23:30 +08:00
chen	544ea9cbc2	check max_logprobs (#5018)	2025-11-14 17:18:06 +08:00
Sunny-bot1	249feca65a	[BugFix] Revert skip capture (#5023) ... * Revert "[BugFix][Metax] Fix metax compile issue in get_block_shape_and_split_kv_block (#5000)" This reverts commit 05da8e34c0. * Revert "skip DtoH capture (#4988)" This reverts commit 5b24013d46.	2025-11-13 23:52:51 -08:00
周周周	51b1f13547	[Executor]move batch_id_per_token (#4853)	2025-11-14 15:38:48 +08:00
周周周	c0a4393d72	[ATTENTION] unitest (#4962)	2025-11-14 13:45:53 +08:00
YuBaoku	91d34c2e35	[CI] Temporarily lock paddlepaddle-gpu as of 20251112 (#5017)	2025-11-14 11:55:25 +08:00
Echo-Nie	ee1ea43e36	[Docs] Fix broken commitID (#5008) ... * fix commitID * Update nvidia_gpu.md	2025-11-14 10:39:41 +08:00
essos	191a597d9f	[CI]【Hackathon 9th Sprint No.56】NO.56 功能模块 fastdeploy/multimodal/utils.py 单测补充 (#4954) ... * update test utils * update test utils code * update test file name	2025-11-14 10:37:27 +08:00
Juncai	36822fa49c	[PD Disaggregation] remove splitwise deployment on single node and refine the code (#4891) ... * remove splitwise deployment on single node and refine the code * up * up * up * add test * up	2025-11-14 09:56:53 +08:00
kxz2002	9703108c28	[BugFix] adjust max_tokens and min_tokens when continue to generate tokens (#5010) ... * fix max and min tokens initial commit * fix double subtraction * add unit tests	2025-11-13 23:52:54 +08:00
carryyu	6c3d1da62f	fix conflicts	2025-11-13 20:30:29 +08:00
yangjianfengo1	ae7bee8122	【New Feature】W4afp8 supports per group quantization (#4987) ... * w4afp8 支持per group * code style * fix transpose * revert fast hardmard --------- Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com> Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-13 19:17:27 +08:00
Echo-Nie	a5e949d9d0	[Feature] Enhance build script, add pre_wheel logic (#4729) ... * Enhance build script, add pre_wheel logic Updated copyright year and added precompiled wheel installation logic. * update the nvidia_gpu.md, add pre_wheel description * fix zh .md * update the url, automatically detect CUDA and SM * Fix GPU architecture string formatting in build.sh * Change default for FD_USE_PRECOMPILED to 0 * fix build.sh * add ./dist, pre-wheel path * simplify the process,just save the whl * del pre_wheel dir * fix function name, extract_ops_from_precompiled_wheel * fix docs * add default commitID in docs --------- Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-13 19:03:52 +08:00
Sunny-bot1	05da8e34c0	[BugFix][Metax] Fix metax compile issue in get_block_shape_and_split_kv_block (#5000) ... * fix metax compile * fix	2025-11-13 00:55:06 -08:00
zccjjj	88da9d9788	[XPU] [CI] Change CI ep test from offline to online (#4885) ... * change CI ep test from offline to online * add ep all2all ci's changes, from offline to online * change env var in ep-all2all ci test * add expected response for ep8tp8 all2all * Adapt to CI refactoring and support dual-concurrent code execution * Adapt to CI refactoring and support dual-concurrent, second * Explicitly specify the #port * change the startup method of all2all * Modify the command of all2all * Update assertion to check multiple keywords * Update assertion to check multiple keywords * Update run_w4a8.py * Update run_w4a8.py --------- Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-13 16:15:45 +08:00
bukejiyu	4a0d881e15	update (#4985)	2025-11-13 15:58:01 +08:00