Yzc216 466cbb5a99 [Feature] Models api (#3073) ...

* add v1/models interface related

* add model parameters

* default model verification

* unit test

* check model err_msg

* unit test

* type annotation

* model parameter in response

* modify document description

* modify document description

* unit test

* verification

* verification update

* model_name

* pre-commit

* update test case

* update test case

* Update tests/entrypoints/openai/test_serving_models.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/entrypoints/openai/test_serving_models.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/entrypoints/openai/test_serving_models.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update tests/entrypoints/openai/test_serving_models.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update fastdeploy/entrypoints/openai/serving_models.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: LiqinruiG <37392159+LiqinruiG@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

2025-08-21 17:02:56 +08:00

..

cache_manager

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

Add custom op declaration for all_reduce (#3473)

2025-08-20 20:29:58 +08:00

engine

[Feature] Models api (#3073)

2025-08-21 17:02:56 +08:00

entrypoints

[Feature] Models api (#3073)

2025-08-21 17:02:56 +08:00

input

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

inter_communicator

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[Trace]add trace when fd start (#3174)

2025-08-05 21:18:27 +08:00

model_executor

[BugFix][V1 Loader] fix the bug in creat weight for block_wise_fp8 (#3486)

2025-08-20 05:52:54 -07:00

multimodal

Remove useless code (#3337)

2025-08-12 10:32:31 +08:00

output

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

platforms

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

plugins

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

reasoning

add Tool Parser (#3272)

2025-08-13 01:06:55 +08:00

rl

fix some bug (#3434)

2025-08-18 14:39:13 +08:00

scheduler

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

spec_decode

[Code Simplification] remove cum_offsets (#3410)

2025-08-18 20:21:25 +08:00

splitwise

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

worker

revert pr (#3481)

2025-08-21 14:19:50 +08:00

__init__.py

[BugFix] Fix default log level of paddleformers (#3376)

2025-08-14 11:36:24 +08:00

config.py

[Excutor] Change cudagraph hashkey from batch size to num_tokens (#3454)

2025-08-18 16:16:48 +08:00

envs.py

[Feature] add dealer manager to reuse the connection (#3471)

2025-08-21 13:11:13 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

add error log to file (#3431)

2025-08-20 09:52:34 +08:00