lizhenyun01 29c3292f02 support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

..

attention

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

backends

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

moe

update (#2978)

2025-07-24 00:16:42 +08:00

quantization

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

sample

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

embeddings.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

linear.py

[Code Simplification] fix init_distributed_environment() (#2982)

2025-07-24 11:43:28 +08:00

lm_head.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rotary_embedding.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

update (#2978)

2025-07-24 00:16:42 +08:00