chenjian c487b62ee0 [Bug fix] Fix memory allocation (#3475) ...

* Support batched tokens for EP

* Support batched tokens for EP

* Support batched tokens for EP

* Support batched tokens for EP

* Support batched tokens for EP and fix bug

* Support batched tokens for EP and fix bug

* Support batched tokens for EP and fix bug

* Support batched tokens for EP and fix bug

* Fix bug for memory allocation

2025-08-19 19:48:24 +08:00

..

sched

[Feature] block scheduler v1 support prefix caching (#3061)

2025-07-31 19:29:19 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Feature] Support ep pd with external module (#3194)

2025-08-04 20:32:41 +08:00

config.py

[Bug fix] Fix memory allocation (#3475)

2025-08-19 19:48:24 +08:00

engine.py

[Feature] Support batched tokens for EP (#3415)

2025-08-18 11:43:36 +08:00

expert_service.py

[Feature] Support batched tokens for EP (#3415)

2025-08-18 11:43:36 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

request.py

[Feature] Support ep pd with external module (#3194)

2025-08-04 20:32:41 +08:00

resource_manager.py

[Bug fix] Fix bug for seq_len_encoder is 1 (#3467)

2025-08-19 15:21:32 +08:00

sampling_params.py

[Feature] support bad_words (#3055)

2025-07-30 09:31:29 +08:00