周周周 da6b4c10e5 [ATTENTION] make buffer alloc as a function (#4945)

2025-11-11 19:17:08 +08:00

..

attention

[ATTENTION] make buffer alloc as a function (#4945)

2025-11-11 19:17:08 +08:00

backends

[Metax] support ERNIE-4.5-VL-28B (#4820)

2025-11-07 04:55:49 -08:00

moe

[Iluvatar] add vl into ci and support v1 loader (#4774)

2025-11-11 10:50:17 +08:00

pool

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

quantization

[TSP] Support qwen3 moe tsp + cudagraph (#4871)

2025-11-10 23:37:51 +08:00

sample

[Perf] Support tensor transmission between work and engine with zero-copy to improve efficiency (#4839)

2025-11-11 15:43:11 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

fix the get_act_fn,_load_st_projector (#4824)

2025-11-06 16:13:35 +08:00

embeddings.py

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

linear.py

[TSP] Support qwen3 moe tsp + cudagraph (#4871)

2025-11-10 23:37:51 +08:00

lm_head.py

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

mtp_linear.py

[Speculative Decoding][MTP]Support mtp in epdptp mode (#4614)

2025-10-28 16:02:47 +08:00

normalization.py

[TSP] Support qwen3 moe tsp + cudagraph (#4871)

2025-11-10 23:37:51 +08:00

pooler.py

fix the get_act_fn,_load_st_projector (#4824)

2025-11-06 16:13:35 +08:00

rotary_embedding.py

[Feature] Support Paddle-OCR (#4396)

2025-10-24 23:34:30 +08:00

utils.py

[OPs] MoE support wfp8afp8(channelwise) and improve per_token_quant_fp8 (#4238)

2025-09-24 16:39:51 +08:00