AIbin a7392a0ff9 【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886) ...

* support MLA chunk_size auto search & cuda_graph

2025-09-11 10:46:09 +08:00

..

graph_optimization

[Executor] Adjust signal sending order in RL training (#3773)

2025-09-10 13:24:20 +08:00

guided_decoding

[Feature] mm and thinking model support structred output (#2749)

2025-09-02 16:21:09 +08:00

layers

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

model_loader

cache feature (#3857)

2025-09-07 18:52:46 +08:00

models

[Feature] Support zai-org/GLM-4.5-Air BF16 model (#3928)

2025-09-10 19:36:10 +08:00

ops

fix cpu __ini__.py (#3448)

2025-08-17 12:38:54 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

forward_meta.py

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

load_weight_utils.py

cache feature (#3857)

2025-09-07 18:52:46 +08:00

pre_and_post_process.py

support mtp in v1_scheduler mode (#3695)

2025-09-04 17:39:59 +08:00

utils.py

cache feature (#3857)

2025-09-07 18:52:46 +08:00