3853 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
fmiao2372	e43a5fc055	[Intel HPU] enable level 1 prefix caching and fix some bugs (#4971) ... * [Intel HPU] enable prefix caching and dense tp moe ep and fix some bugs * update code by copilot * remove dense tp and moe ep code	2025-11-14 19:42:50 +08:00
plusNew001	0e819cd596	[CI][XPU] Optimize CI logs and variable names (#5025) ... * Ignore markdown and text files in CI workflow * Change GPU_ID to XPU_ID in run_ci_xpu.sh * Change GPU_ID to XPU_ID in test configuration * Change GPU_ID to XPU_ID for service port calculation * Change GPU_ID to XPU_ID for device identification * Change GPU_ID to XPU_ID in test_ep function * Update run_w4a8.py * Redirect stop_processes output to kill.log Redirect output of stop_processes to kill.log to capture logs. * Log server output for failed test cases Added logging of server.log for failed tests. * Add '-s' option to pytest commands in run_ci_xpu.sh	2025-11-14 19:35:35 +08:00
Jiang-Jia-Jun	d41cf643f8	Update nvidia_gpu.md	2025-11-14 18:26:08 +08:00
Jiang-Jia-Jun	692d69229b	Update nvidia_gpu.md	2025-11-14 18:17:32 +08:00
Daci	5fc12eddfe	[Optimization] xgrammar async compile, multi thread, speed up (#4835) ... * xgrammar async compile, multi thread, speed up * fix test_sampler.py & pre-commit err * add redis version check && fix request.llm_engine_recv_req_timestamp * xgrammar prefill & decode & v0 * fix test_gpu_prompt_logprobs.py * add test_guided_decoding.py * Update fastdeploy/scheduler/splitwise_scheduler.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/model_executor/guided_decoding/xgrammar_backend.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/model_executor/guided_decoding/xgrammar_backend.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Apply suggestions from code review Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix torch xgrammar unittest env --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-11-14 18:05:26 +08:00
Winters Montagne	b925533051	add test_process_video.py (#5011)	2025-11-14 17:23:30 +08:00
chen	544ea9cbc2	check max_logprobs (#5018)	2025-11-14 17:18:06 +08:00
Sunny-bot1	249feca65a	[BugFix] Revert skip capture (#5023) ... * Revert "[BugFix][Metax] Fix metax compile issue in get_block_shape_and_split_kv_block (#5000)" This reverts commit 05da8e34c0. * Revert "skip DtoH capture (#4988)" This reverts commit 5b24013d46.	2025-11-13 23:52:51 -08:00
周周周	51b1f13547	[Executor]move batch_id_per_token (#4853)	2025-11-14 15:38:48 +08:00
周周周	c0a4393d72	[ATTENTION] unitest (#4962)	2025-11-14 13:45:53 +08:00
YuBaoku	91d34c2e35	[CI] Temporarily lock paddlepaddle-gpu as of 20251112 (#5017)	2025-11-14 11:55:25 +08:00
Echo-Nie	ee1ea43e36	[Docs] Fix broken commitID (#5008) ... * fix commitID * Update nvidia_gpu.md	2025-11-14 10:39:41 +08:00
essos	191a597d9f	[CI]【Hackathon 9th Sprint No.56】NO.56 功能模块 fastdeploy/multimodal/utils.py 单测补充 (#4954) ... * update test utils * update test utils code * update test file name	2025-11-14 10:37:27 +08:00
Juncai	36822fa49c	[PD Disaggregation] remove splitwise deployment on single node and refine the code (#4891) ... * remove splitwise deployment on single node and refine the code * up * up * up * add test * up	2025-11-14 09:56:53 +08:00
kxz2002	9703108c28	[BugFix] adjust max_tokens and min_tokens when continue to generate tokens (#5010) ... * fix max and min tokens initial commit * fix double subtraction * add unit tests	2025-11-13 23:52:54 +08:00
carryyu	6c3d1da62f	fix conflicts	2025-11-13 20:30:29 +08:00
yangjianfengo1	ae7bee8122	【New Feature】W4afp8 supports per group quantization (#4987) ... * w4afp8 支持per group * code style * fix transpose * revert fast hardmard --------- Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com> Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-13 19:17:27 +08:00
Echo-Nie	a5e949d9d0	[Feature] Enhance build script, add pre_wheel logic (#4729) ... * Enhance build script, add pre_wheel logic Updated copyright year and added precompiled wheel installation logic. * update the nvidia_gpu.md, add pre_wheel description * fix zh .md * update the url, automatically detect CUDA and SM * Fix GPU architecture string formatting in build.sh * Change default for FD_USE_PRECOMPILED to 0 * fix build.sh * add ./dist, pre-wheel path * simplify the process,just save the whl * del pre_wheel dir * fix function name, extract_ops_from_precompiled_wheel * fix docs * add default commitID in docs --------- Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-13 19:03:52 +08:00
Sunny-bot1	05da8e34c0	[BugFix][Metax] Fix metax compile issue in get_block_shape_and_split_kv_block (#5000) ... * fix metax compile * fix	2025-11-13 00:55:06 -08:00
zccjjj	88da9d9788	[XPU] [CI] Change CI ep test from offline to online (#4885) ... * change CI ep test from offline to online * add ep all2all ci's changes, from offline to online * change env var in ep-all2all ci test * add expected response for ep8tp8 all2all * Adapt to CI refactoring and support dual-concurrent code execution * Adapt to CI refactoring and support dual-concurrent, second * Explicitly specify the #port * change the startup method of all2all * Modify the command of all2all * Update assertion to check multiple keywords * Update assertion to check multiple keywords * Update run_w4a8.py * Update run_w4a8.py --------- Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-13 16:15:45 +08:00
bukejiyu	4a0d881e15	update (#4985)	2025-11-13 15:58:01 +08:00
周周周	6c4ebc5fee	[worker_process.py]modify some var name (#4749)	2025-11-13 14:21:27 +08:00
Yonghua Li	6c5ab727c1	[BugFix] fix num_requests_running after clear_data (#4927) ... * [BugFix] fix num_requests_running after clear_data * [fix] fix tasks_list and stop flags not cleared when _free_blocks failed	2025-11-13 13:50:21 +08:00
Sunny-bot1	5b24013d46	skip DtoH capture (#4988)	2025-11-13 10:57:44 +08:00
Jiang-Jia-Jun	8329338d37	Update nvidia_gpu.md	2025-11-13 10:25:22 +08:00
ltd0924	303c986cc7	[FDConfig] add block number verfied (#4983) ... * Update config.py * fix * update unit test --------- Co-authored-by: ltd0924 <luotingdan@baidu.com>	2025-11-13 09:48:44 +08:00
YuBaoku	1c0b0b08b7	[CI] set DG_NVCC_OVERRIDE_CPP_STANDARD in test_quantized_linear (#4995)	2025-11-12 23:03:21 +08:00
Yuanle Liu	2272160faf	fix mtp tsp (#4990)	2025-11-12 22:05:19 +08:00
ming1753	3148dbca06	[BugFix] fix VL fp8 bug when moe token_num is 0 (#4928) ... * [BugFix] fix VL fp8 bug when moe token_num is 0 * fix bug * format * fix bug	2025-11-12 21:19:36 +08:00
Jiang-Jia-Jun	c8140326fa	Update nvidia_gpu.md	2025-11-12 20:50:09 +08:00
bukejiyu	f0189292df	[CI] fix test_model_cache (#4982) ... * ci * update	2025-11-12 20:26:49 +08:00
qwes5s5	a2d06118e1	[Logprobs]Support prompt_logprobs and max_logprobs (#4897) ... * add prompt logprobs * trigger ci * fix unitest * Update fastdeploy/config.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/entrypoints/llm.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/engine/sampling_params.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/engine/test_sampling_params.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/engine/test_sampling_params.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix max_logprobs --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-11-12 19:29:48 +08:00
Lucas	da7863ae85	[XPU] fix text_image_gather_scatter when image_token_num == token_num && text_token_num == 1 (#4882)	2025-11-12 17:13:22 +08:00
JYChen	a1218076dc	remove load default_v1 since already been as default (#4980)	2025-11-12 16:49:48 +08:00
xiaozude	c45b3ccb52	[Metax] optimize flash mla (#4915)	2025-11-12 16:43:46 +08:00
MingkunZhang	9d9f5df8d0	[Metax] support default_v1 loader & thinking model (#4956) ... Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>	2025-11-12 16:32:26 +08:00
BossPi	bde6e2f931	[BugFix] Avoid loading training file (#4966) ... * bug fix don't put scheduler.pdparams into model weights * run pre-commit	2025-11-12 15:49:14 +08:00
plusNew001	c7b589d75b	[CI][XPU] Fix EP Case Bug (#4976) ... * Update health check endpoint to use port variable * Update scripts/run_ci_xpu.sh Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update scripts/run_ci_xpu.sh Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update scripts/run_ci_xpu.sh Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update installation method for paddlepaddle-xpu Revert to installing paddlepaddle-xpu from the official repository. * Modify XPU_VISIBLE_DEVICES based on GPU_ID --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-11-12 15:23:28 +08:00
bukejiyu	6e2e2fcd29	xpu (#4969)	2025-11-12 15:12:59 +08:00
ltd0924	5bf48de999	[KVCache] support unified cache backend (#4903) ... * [Feature] support unified cache backend * fix * fix * fix * fix * Update metax_model_runner.py * fix * update * Update test_moba_attention_backend.py --------- Co-authored-by: ltd0924 <luotingdan@baidu.com>	2025-11-12 14:54:52 +08:00
yzwu	76e60e98f8	[Iluvatar][CI] fix safetensors_rust.SafetensorError: framework paddle is invalid (#4972)	2025-11-12 14:13:40 +08:00
Sunny-bot1	35bd2afab3	[Benchmark] Add GEMM & MoE kernel bench (#4809)	2025-11-12 11:56:40 +08:00
YuBaoku	8a96944a0a	[CI] Update PORT range to avoid conflict with system ports (#4953)	2025-11-12 11:17:49 +08:00
Jiang-Jia-Jun	09cd6c5d3e	Modify README	2025-11-12 11:03:23 +08:00
YuBaoku	9c52d9eb8f	[CI] remove useless tests in docker_build (#4974) ... * [CI] fix * [CI] fix apt_sources error of focal in docker_build * [CI] remove useless tests in docker_build	2025-11-12 10:55:09 +08:00
Echo-Nie	ff653503ff	[Docs] Add License in Unittest (#4957) ... * add copyright * add CopyRight	2025-11-12 10:44:09 +08:00
Echo-Nie	2aabaecbc2	[CI] Add five unittest (#4958) ... * add unittest * Update test_logger.py	2025-11-12 10:43:33 +08:00
plusNew001	a5103eb198	[CI][XPU] Change Paddle Version to Nightly (#4973) ... * Update health check endpoint to use port variable * Update scripts/run_ci_xpu.sh Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update scripts/run_ci_xpu.sh Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update scripts/run_ci_xpu.sh Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update installation method for paddlepaddle-xpu Revert to installing paddlepaddle-xpu from the official repository. --------- Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-11-12 10:29:16 +08:00
bukejiyu	b09ebb2813	refactor pt loading (#4532)	2025-11-11 21:30:39 +08:00
YuBaoku	4c911ecb74	[CI] fix apt_sources error of focal in docker_build (#4961) ... * [CI] fix * [CI] fix apt_sources error of focal in docker_build	2025-11-11 20:35:06 +08:00