freeliuzc 19653ee03a [Speculative Decoding]Support different inferseed in speculate decoding (#5569) ...

* fix mtp entropy drop in RL

* fix unit test

* optimize padding_sampling_params speed(vectorized)

2025-12-17 16:54:24 +08:00

..

attention

[MTP]Merge support attn (#4591)

2025-10-27 21:13:08 +08:00

backends

[Cherry-Pick][RL] Support Rollout Routing Replay (#5166)

2025-12-04 00:35:30 -08:00

moe

[Cherry-Pick][RL] R3 Support RDMA Store (#5454)

2025-12-17 09:50:53 +08:00

quantization

cp dynamic Cfp8 (#4120)

2025-09-17 11:55:47 +08:00

sample

[Speculative Decoding]Support different inferseed in speculate decoding (#5569)

2025-12-17 16:54:24 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Polish Code] Remove useless notes

2025-08-14 14:04:52 +08:00

embeddings.py

[Feature] support rl_tp_degree (#3934)

2025-09-08 16:20:32 +08:00

linear.py

fix skip_quant (#5342)

2025-12-03 13:20:51 +08:00

lm_head.py

[Feature] support rl_tp_degree (#3934)

2025-09-08 16:20:32 +08:00

mtp_linear.py

support mtp in hybird-dp-tp mode (#4299)

2025-09-28 15:58:45 +08:00

normalization.py

adaptive rms_norm's dtype (#3617)

2025-08-26 15:29:15 +08:00

rotary_embedding.py

[Model]support qwen2_5_vl (#3557)

2025-08-29 18:28:39 +08:00

utils.py

fix mem boom in ep (#3852)

2025-09-04 10:38:34 +08:00