AIbin a7392a0ff9 【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886) ...

* support MLA chunk_size auto search & cuda_graph

2025-09-11 10:46:09 +08:00

..

cpu_ops

fix typos (#3951)

2025-09-08 15:22:41 +08:00

gpu_ops

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

iluvatar_ops

fix typos (#3684)

2025-09-01 17:50:17 +08:00

utils

【Fix bug] w4afp8 的nblock固定为256，并且fa3的append attn 增加mask参数 (#3771)

2025-09-02 19:17:01 +08:00

xpu_ops

[xpu] add ep custom ops (#3911)

2025-09-10 12:22:50 +08:00

0001-DeepGEMM-95e81b3.patch

[feat] support fa3 backend for pd disaggregated (#2695)

2025-07-03 22:33:27 +08:00

MANIFEST.in

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

setup_ops_cpu.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

setup_ops.py

[xpu] add ep custom ops (#3911)

2025-09-10 12:22:50 +08:00