Jundong Liu 1e4968e810 [Excutor] Fixed the issue of CUDA graph execution failure caused by different branches during decoding (#3223) ...

* 彻底解决解码切块问题

* update C8 and C4 kernel

* fix problem

* fix with pre-commit

* retain branch for mtp

2025-08-09 07:37:19 +08:00

..

cpu_ops

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

gpu_ops

[Excutor] Fixed the issue of CUDA graph execution failure caused by different branches during decoding (#3223)

2025-08-09 07:37:19 +08:00

iluvatar_ops

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

utils

[New Feature] Support W4Afp8 MoE GroupGemm (#3171)

2025-08-06 10:34:05 +08:00

xpu_ops

[XPU] Support kvblock centralized management (#3017)

2025-07-29 10:40:55 +08:00

0001-DeepGEMM-95e81b3.patch

[feat] support fa3 backend for pd disaggregated (#2695)

2025-07-03 22:33:27 +08:00

MANIFEST.in

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

setup_ops_base.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

setup_ops_cpu.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

setup_ops.py

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00