YuanRisheng 2e9e53ff7e [FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116) ...

* remove max_num_batched_tokens in parallel config

* remove max_num_seqs

* update test case

* fix test

* fix

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-09-17 10:43:35 +08:00

..

attention

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

backends

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

moe

[xpu] support ep (#4067)

2025-09-15 13:53:11 +08:00

quantization

fix bf16 and add comments (#4106)

2025-09-15 17:23:07 +08:00

sample

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Polish Code] Remove useless notes

2025-08-14 14:04:52 +08:00

embeddings.py

[Feature] ernie4_5_vl_moe support huggingface safetensor loading (#3750)

2025-09-03 02:58:59 -07:00

linear.py

fix bf16 and add comments (#4106)

2025-09-15 17:23:07 +08:00

lm_head.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

mtp_linear.py

support tmp (#3675)

2025-08-28 19:42:32 +08:00

normalization.py

adaptive rms_norm's dtype (#3617)

2025-08-26 15:29:15 +08:00

rotary_embedding.py

[Feature] refactor metax_gpu attention and moe and remove some useless code (#3688)

2025-09-12 14:40:25 +08:00

utils.py

fix mem boom in ep (#3854)

2025-09-05 11:48:21 +08:00