周周周 c83dc58105 [Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

..

attention

[BugFix] Fix flash_attn_backend

2025-12-05 14:33:38 +08:00

backends

[XPU] [Optimization] [EP] EP communication optimization. (#5145)

2025-12-05 10:03:45 +08:00

batch_invariant_ops

[Deterministic] Move paddle version batch invariant pkg to Fastdeploy (#4763)

2025-12-01 11:25:48 +08:00

moe

[Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

pool

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

quantization

[BugFix] dynamic cache kv block_wise_fp8 not need create layer.cache_k_scale (#5362)

2025-12-03 05:32:59 -08:00

sample

[xpu] support mtp for xpu(mix) (#5274)

2025-12-01 11:03:14 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

fix the get_act_fn,_load_st_projector (#4824)

2025-11-06 16:13:35 +08:00

embeddings.py

[Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

linear.py

deepseek torch (#5373)

2025-12-04 23:26:53 +08:00

lm_head.py

[Optimization] Refine row parallel bias and nranks and moe all_reduce (#5247)

2025-11-26 05:09:09 -08:00

mtp_linear.py

[BugFix]fix v1 loader lm head fp32 (#5270)

2025-11-27 20:12:56 +08:00

normalization.py

[UNITEST] add test (#5305)

2025-12-02 17:59:01 +08:00

pooler.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

rotary_embedding.py

[Feature] Support Paddle-OCR (#4396)

2025-10-24 23:34:30 +08:00

utils.py

[Quantization] Support w4afp8 MoE dynamic quantization (#5282)

2025-12-02 18:56:16 +08:00