Longzhi Wang add524d80c [Feature] support chunked moe (#4575) ...

* [Feature] support chunked moe

* update

* update

* fix and add test

* update

* fix conflict and modity test

* fix fused_moe

* fix fused_moe

* fix docstring

* fix

* fix typo

* fix test

* fix

* fix

* fix test

* fix test

2025-12-01 15:17:18 +08:00

..

attention

[Feature] support flash_mask_attention backend (#5134)

2025-11-28 10:12:16 +08:00

backends

[Intel HPU] change MoE weights and scales from list to tensor and add… (#5289)

2025-11-28 19:17:05 +08:00

batch_invariant_ops

[Deterministic] Move paddle version batch invariant pkg to Fastdeploy (#4763)

2025-12-01 11:25:48 +08:00

moe

[Feature] support chunked moe (#4575)

2025-12-01 15:17:18 +08:00

pool

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

quantization

support moe offline quant (#5142)

2025-11-24 18:59:18 +08:00

sample

[xpu] support mtp for xpu(mix) (#5274)

2025-12-01 11:03:14 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

fix the get_act_fn,_load_st_projector (#4824)

2025-11-06 16:13:35 +08:00

embeddings.py

[Features] add audio request & fix embedding bug (#5201)

2025-12-01 11:12:17 +08:00

linear.py

[BugFix]Set default OMP_NUM_THREADS=3 and fix extra GPU memory usage in DeepSeek (#5219)

2025-11-28 14:22:04 +08:00

lm_head.py

[Optimization] Refine row parallel bias and nranks and moe all_reduce (#5247)

2025-11-26 05:09:09 -08:00

mtp_linear.py

[BugFix]fix v1 loader lm head fp32 (#5270)

2025-11-27 20:12:56 +08:00

normalization.py

[TSP] Support qwen3 moe tsp + cudagraph (#4871)

2025-11-10 23:37:51 +08:00

pooler.py

fix the get_act_fn,_load_st_projector (#4824)

2025-11-06 16:13:35 +08:00

rotary_embedding.py

[Feature] Support Paddle-OCR (#4396)

2025-10-24 23:34:30 +08:00

utils.py

[BugFix]Set default OMP_NUM_THREADS=3 and fix extra GPU memory usage in DeepSeek (#5219)

2025-11-28 14:22:04 +08:00