【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

Browse Source

* support MLA chunk_size auto search & cuda_graph

...

This commit is contained in:

AIbin

2025-09-11 10:46:09 +08:00

committed by GitHub

parent 637d96c6ae

commit a7392a0ff9

23 changed files with 375 additions and 310 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

docs/quantization/wint2.png

Binary file not shown.

Side by Side Before Width:  |  Height:  |  Size: 81 KiB

BIN

docs/zh/quantization/wint2.png

Binary file not shown.

Side by Side Before Width:  |  Height:  |  Size: 81 KiB