9 Commits

Author	SHA1	Message	Date
lzy	1e06b9fa6d	make append_attn supports mask_offset (#3138) ... * make append_attn supports mask_offset * add unittest	2025-08-14 03:40:55 -07:00
Yuan Xiaolan	7ce00e597c	support qk norm (#3145)	2025-08-05 16:46:14 +08:00
lifulll	2c6a9e887e	native top_p_sampling (#2901)	2025-07-22 14:09:59 +08:00
Zero Rains	25698d56d1	polish code with new pre-commit rule (#2923)	2025-07-19 23:19:27 +08:00
周周周	ddb10ac509	[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880) ... * remove padding_offsets from atten	2025-07-17 18:41:31 +08:00
周周周	aa76085d1f	[Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870) ... [Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870)	2025-07-16 20:10:57 +08:00
lifulll	1f28bdf994	dcu adapter ernie45t (#2756) ... Co-authored-by: lifu <lifu@sugon.com> Co-authored-by: yongqiangma <xing.wo@163.com>	2025-07-09 18:56:27 +08:00
Jiang-Jia-Jun	92c2cfa2e7	Sync v2.0 version of code to github repo	2025-06-29 23:29:37 +00:00
jiangjiajun	684703fd72	[LLM] First commit the llm deployment code	2025-06-09 19:20:15 +08:00