apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
3,751 Commits 29 Branches 10 Tags
819b2dbbae87243c3db6cf2a772600a6c99fbdb7
Commit Graph

2 Commits

Author SHA1 Message Date
SunLei
809c1ac7ec feat: add post-processing step for pool_output (#4462) 
* feat: add post-processing step for pool_output

* bugfix

* fix: test_serving_embedding

* fix test_request_to_batch_dicts

* fix: code style
 2025-10-21 20:24:26 +08:00
SunLei
b4b579a7ed Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344) 
* feat: add OpenAIServing

* feat: add ZmqOpenAIServing & OpenAIServingEmbedding

* feat: Refine the basic ServingEngine class and introduce ServingContext

* fix: codestyle

* fix: request

* fix: pooling_params

* feat: _process_chat_template_kwargs

* feat: support batch request

* feat: pooling_params verify & default parameters

---------

Co-authored-by: sunlei1024 <sunlei1024@example.com>
 2025-10-15 19:42:59 +08:00