SunLei b4b579a7ed Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344) ...

* feat: add OpenAIServing

* feat: add ZmqOpenAIServing & OpenAIServingEmbedding

* feat: Refine the basic ServingEngine class and introduce ServingContext

* fix: codestyle

* fix: request

* fix: pooling_params

* feat: _process_chat_template_kwargs

* feat: support batch request

* feat: pooling_params verify & default parameters

---------

Co-authored-by: sunlei1024 <sunlei1024@example.com>

2025-10-15 19:42:59 +08:00

..

sched

[fix] fix requests & block metrics (#4404)

2025-10-15 11:49:24 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

common_engine.py

[BUGFIX] clear request #4286 (#4402)

2025-10-15 17:43:28 +08:00

engine.py

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00

expert_service.py

[XPU] fix ep (#4393)

2025-10-15 11:41:05 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooling_params.py

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

request.py

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

resource_manager.py

[fix] fix requests & block metrics (#4404)

2025-10-15 11:49:24 +08:00

sampling_params.py

fix reasoning_max_tokens (#4277)

2025-09-28 14:05:29 +08:00

tasks.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00