Yuan Xiaolan b1d787a272 [fix] w4a8 model loading and hadamard config (#3013)

2025-07-28 18:17:59 +08:00

..

attention

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

backends

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

moe

[fix] w4a8 model loading and hadamard config (#3013)

2025-07-28 18:17:59 +08:00

quantization

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

sample

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

embeddings.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

linear.py

[Code Simplification] fix init_distributed_environment() (#2982)

2025-07-24 11:43:28 +08:00

lm_head.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rotary_embedding.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00