SunLei b4b579a7ed Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344) ...

* feat: add OpenAIServing

* feat: add ZmqOpenAIServing & OpenAIServingEmbedding

* feat: Refine the basic ServingEngine class and introduce ServingContext

* fix: codestyle

* fix: request

* fix: pooling_params

* feat: _process_chat_template_kwargs

* feat: support batch request

* feat: pooling_params verify & default parameters

---------

Co-authored-by: sunlei1024 <sunlei1024@example.com>

2025-10-15 19:42:59 +08:00

..

benchmarks

[FastDeploy Cli] Bench Command eval and throughput (#4239)

2025-10-10 16:17:44 +08:00

ce

[XPU] Support W4A8C8-TP4-300B Model (#4068)

2025-10-10 15:41:32 +08:00

ci_use

[XPU] fix XPU CI bug (#4358)

2025-10-11 14:48:14 +08:00

distributed

fix typos (#4176)

2025-09-22 14:27:17 +08:00

e2e

【Fix CI Bug】Fix ci bug (#4413)

2025-10-15 14:19:04 +08:00

entrypoints

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

graph_optimization

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00

input

[fix]update apply_chat_template (#4137)

2025-09-24 18:56:32 +08:00

layers

[Optimization] Fuse get_max_len and get_kv_max_len (#4369)

2025-10-13 20:35:00 +08:00

logger

…

metrics

[fix] Fixed the issue of excessive/redundant spans being returned for streaming requests. (#4375)

2025-10-15 11:47:47 +08:00

model_executor

…

model_loader

[v1 loader]code style (#4204)

2025-09-23 19:36:00 +08:00

operators

fix param (#4419)

2025-10-15 18:44:24 +08:00

output

fix typos (#4093)

2025-09-15 18:33:30 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

pooling

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

[Supplements and upgrades]Improvement of X1 parsers (#4172)

2025-09-26 13:37:37 +08:00

utils

[BugFix] fix multinode bugs (#4377)

2025-10-15 11:43:39 +08:00

v1

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00

conftest.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

cov_pytest.ini

[CI] Fix partial instability issues (#4418)

2025-10-15 11:13:43 +08:00

utils.py

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00