bukejiyu 8e203666d9 w4a8 offline (#3074) ...

* w4a8 offline

* update

* update

* update

2025-07-30 16:33:30 +08:00

..

attention

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

backends

support W4A8 EPLB (#3075)

2025-07-30 14:34:12 +08:00

moe

support W4A8 EPLB (#3075)

2025-07-30 14:34:12 +08:00

quantization

support model loading for w4a8 offline quant (#3064)

2025-07-29 21:54:37 +08:00

sample

[Feature] Support repetition early stop (#3024)

2025-07-29 22:42:54 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

embeddings.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

linear.py

[Code Simplification] fix init_distributed_environment() (#2982)

2025-07-24 11:43:28 +08:00

lm_head.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rotary_embedding.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

w4a8 offline (#3074)

2025-07-30 16:33:30 +08:00