yzwu fbdd6b0663 [Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

..

sched

[Feature] block scheduler v1 support prefix caching (#3061)

2025-07-31 19:29:19 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Feature] support seed parameter (#3161)

2025-08-06 15:20:47 +08:00

config.py

[Feature] remove dependency on enable_mm and refine multimodal's code (#3014)

2025-08-01 20:01:18 +08:00

engine.py

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

expert_service.py

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

request.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

resource_manager.py

remove useless code (#3166)

2025-08-04 18:03:08 +08:00

sampling_params.py

[FIX]fix bad_words when sending requests consecutively (#3197)

2025-08-04 05:59:41 -07:00