gaoziyuan 896e3bb606 [NewFeture]add ep rollout model init and update/clear ep buffer (#4039) ...

* fix gid

* merge

* fix test

* fix bug

* fix

* fix ci

2025-09-17 20:24:53 +08:00

..

attention

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

backends

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

moe

[NewFeture]add ep rollout model init and update/clear ep buffer (#4039)

2025-09-17 20:24:53 +08:00

quantization

fix bf16 and add comments (#4106)

2025-09-15 17:23:07 +08:00

sample

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Polish Code] Remove useless notes

2025-08-14 14:04:52 +08:00

embeddings.py

[Feature] ernie4_5_vl_moe support huggingface safetensor loading (#3750)

2025-09-03 02:58:59 -07:00

linear.py

fix bf16 and add comments (#4106)

2025-09-15 17:23:07 +08:00

lm_head.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

mtp_linear.py

support tmp (#3675)

2025-08-28 19:42:32 +08:00

normalization.py

adaptive rms_norm's dtype (#3617)

2025-08-26 15:29:15 +08:00

rotary_embedding.py

[Feature] refactor metax_gpu attention and moe and remove some useless code (#3688)

2025-09-12 14:40:25 +08:00

utils.py

fix mem boom in ep (#3854)

2025-09-05 11:48:21 +08:00