Yuan Xiaolan 2513cd929b support w4afp8 EP inference (#3382)

2025-08-13 21:41:34 +08:00

..

attention

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

backends

support W4A8 EPLB (#3075) (#3094)

2025-07-30 19:46:42 +08:00

moe

support w4afp8 EP inference (#3382)

2025-08-13 21:41:34 +08:00

quantization

support w4afp8 EP inference (#3382)

2025-08-13 21:41:34 +08:00

sample

【Fix】【MTP】fix mtp bug (#3140)

2025-08-01 15:45:00 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

embeddings.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

linear.py

[Code Simplification] fix init_distributed_environment() (#2982)

2025-07-24 11:43:28 +08:00

lm_head.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rotary_embedding.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00