zhink c08561c13a [Feature] support tensor-parallel-size>num_key_value_heads for qwen3 (#2799)

2025-07-11 15:09:43 +08:00

..

attention

[Executor] Move forward_meta.py to fastdeploy/model_executor (#2774)

2025-07-10 20:36:51 +08:00

backends

[Executor] Move forward_meta.py to fastdeploy/model_executor (#2774)

2025-07-10 20:36:51 +08:00

moe

[Feature] block_wise_fp8 support triton_moe_backend (#2767)

2025-07-09 19:22:47 +08:00

quantization

[Feature] block_wise_fp8 support triton_moe_backend (#2767)

2025-07-09 19:22:47 +08:00

sample

[Fix]fix top_k_top_p sampling (#2801)

2025-07-10 22:35:10 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

embeddings.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

hydra_head.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

linear.py

[Feature] support tensor-parallel-size>num_key_value_heads for qwen3 (#2799)

2025-07-11 15:09:43 +08:00

lm_head.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

mtp_linear.py

Extract eh_proj Layer from ParallelLMHead for MTP to Avoid Weight Transposition Issue (#2707)

2025-07-04 14:15:04 +08:00

normalization.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

rotary_embedding.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

utils.py

Adapt for iluvatar gpu (#2684)

2025-07-07 16:53:14 +08:00