RichardWooSJTU f5c64a074c [EP] Refactor DeepEP Engine Organization for Mixed Mode & Buffer Management Optimization (#3182) ...

* Add support for mixed-ep across multi nodes

* code refine

---------

Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com>

2025-08-05 15:40:11 +08:00

..

attention

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

backends

support W4A8 EPLB (#3075)

2025-07-30 14:34:12 +08:00

moe

[EP] Refactor DeepEP Engine Organization for Mixed Mode & Buffer Management Optimization (#3182)

2025-08-05 15:40:11 +08:00

quantization

fix is_permuted (#3098)

2025-07-31 19:58:05 +08:00

sample

[Feature] Support repetition early stop (#3024)

2025-07-29 22:42:54 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

embeddings.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

linear.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

lm_head.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rotary_embedding.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

w4a8 offline (#3074)

2025-07-30 16:33:30 +08:00