RAM 775edcc09a [Executor] Default use CUDAGraph (#3594) ...

* add start intercept

* Adjustment GraphOptConfig

* pre-commit

* default use cudagraph

* set default value

* default use cuda graph

* pre-commit

* fix test case bug

* disable rl

* fix moba attention

* only support gpu

* Temporarily disable PD Disaggregation

* set max_num_seqs of test case as 1

* set max_num_seqs and temperature

* fix max_num_batched_tokens bug

* close cuda graph

* success run wint2

* profile run with max_num_batched_tokens

* 1.add c++ memchecker 2.success run wint2

* updatee a800 yaml

* update docs

* 1. delete check 2. fix plas attn test case

* default use use_unique_memory_pool

* add try-except for warmup

* ban mtp, mm, rl

* fix test case mock

* fix ci bug

* fix form_model_get_output_topp0 bug

* fix ci bug

* refine deepseek ci

* refine code

* Disable PD

* fix sot yaml

2025-10-21 14:25:45 +08:00

..

cpu_ops

fix typos (#3951)

2025-09-08 15:22:41 +08:00

gpu_ops

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

iluvatar_ops

[Iluvatar GPU] Optimize attention performance and fix moe load ckpt error (#3651)

2025-09-22 21:13:59 +08:00

metax_ops

[fix] adjust mctlass moe api (#4474)

2025-10-20 14:23:54 +08:00

third_party

[setup optimize]Support git submodule (#4033)

2025-09-11 17:41:16 +08:00

utils

【Fix bug] w4afp8 的nblock固定为256，并且fa3的append attn 增加mask参数 (#3771)

2025-09-02 19:17:01 +08:00

xpu_ops

[XPU] bind block_attn kernel with pybind (#4499)

2025-10-21 10:58:52 +08:00

0001-DeepGEMM-95e81b3.patch

[feat] support fa3 backend for pd disaggregated (#2695)

2025-07-03 22:33:27 +08:00

MANIFEST.in

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

setup_ops_cpu.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

setup_ops.py

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00