freeliuzc 52eda7fdb3 [Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

..

cpu_ops

[Code Simplification] remove cum_offsets (#3410)

2025-08-18 20:21:25 +08:00

gpu_ops

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

iluvatar_ops

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

utils

support w4afp8 EP inference (#3044)

2025-08-25 11:27:45 +08:00

xpu_ops

[Feature][XPU] add custom kernels for mtp (#3537)

2025-08-25 10:14:17 +08:00

0001-DeepGEMM-95e81b3.patch

[feat] support fa3 backend for pd disaggregated (#2695)

2025-07-03 22:33:27 +08:00

MANIFEST.in

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

setup_ops_cpu.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

setup_ops.py

[MetaxGPU] adapt to the latest fastdeploy on metax gpu (#3492)

2025-08-25 17:44:20 +08:00