freeliuzc 7cdd8d290d [MTP] optimize mtp infer speed (#2840)

2025-07-14 19:50:22 +08:00

..

attention

Simplify the Config code (#2770)

2025-07-14 19:50:05 +08:00

backends

Simplify the Config code (#2770)

2025-07-14 19:50:05 +08:00

moe

Simplify the Config code (#2770)

2025-07-14 19:50:05 +08:00

quantization

[Feature] block_wise_fp8 support triton_moe_backend (#2767)

2025-07-09 19:22:47 +08:00

sample

[MTP] optimize mtp infer speed (#2840)

2025-07-14 19:50:22 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

embeddings.py

Simplify the Config code (#2770)

2025-07-14 19:50:05 +08:00

hydra_head.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

linear.py

Simplify the Config code (#2770)

2025-07-14 19:50:05 +08:00

lm_head.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

mtp_linear.py

Extract eh_proj Layer from ParallelLMHead for MTP to Avoid Weight Transposition Issue (#2707)

2025-07-04 14:15:04 +08:00

normalization.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

rotary_embedding.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

utils.py

Adapt for iluvatar gpu (#2684)

2025-07-07 16:53:14 +08:00