gaoziyuan 896e3bb606 [NewFeture]add ep rollout model init and update/clear ep buffer (#4039) ...

* fix gid

* merge

* fix test

* fix bug

* fix

* fix ci

2025-09-17 20:24:53 +08:00

..

graph_optimization

[CUDAGraph] Support multi output buffers and merge some fixes from feature/exp_0908 (#4062)

2025-09-15 16:21:30 +08:00

guided_decoding

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

layers

[NewFeture]add ep rollout model init and update/clear ep buffer (#4039)

2025-09-17 20:24:53 +08:00

model_loader

cache feature (#3857)

2025-09-07 18:52:46 +08:00

models

[FDConfig]Remove max_num_batched_tokens/max_num_seqs in parallel config (#4116)

2025-09-17 10:43:35 +08:00

ops

fix typos (#3840)

2025-09-12 11:04:38 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

forward_meta.py

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

load_weight_utils.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

pre_and_post_process.py

Reconstruct streaming data transfer with zmq (#3836)

2025-09-17 14:30:39 +08:00

utils.py

fix bf16 and add comments (#4106)

2025-09-15 17:23:07 +08:00