xiaolei373 55124f8491 Add cli run batch (#4237) ...

* feat(log):add_request_and_response_log

* [cli] add run batch cli

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-09-26 14:27:25 +08:00

..

cache_manager

fix the bug for prefilled_step_idx signal of cache_messager in cudagraph and PD (#4235)

2025-09-24 19:46:52 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

engine

initial commit (#4248)

2025-09-25 21:42:05 +08:00

entrypoints

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00

input

Support limit thinking lengths (#4069)

2025-09-25 19:55:56 +08:00

inter_communicator

[xpu] use cpu barrier (#4181)

2025-09-23 12:19:03 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[metrics] update metrics markdown file (#4061)

2025-09-12 11:13:43 +08:00

model_executor

fix ernie vl distributed attr. (#4215)

2025-09-26 14:18:49 +08:00

multimodal

[MTP]Support mtp reshard (#4099)

2025-09-15 17:13:53 +08:00

output

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

platforms

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

plugins

[Feature] add cli command serve (#4226)

2025-09-24 14:50:45 +08:00

reasoning

[Supplements and upgrades]Improvement of X1 parsers (#4172)

2025-09-26 13:37:37 +08:00

rl

[Test]add glm45_air logprob test and rollout model (#4175)

2025-09-23 21:06:07 +08:00

scheduler

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

spec_decode

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

splitwise

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

transformer_utils

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

worker

Support limit thinking lengths (#4069)

2025-09-25 19:55:56 +08:00

__init__.py

[Feature] add cli command serve (#4226)

2025-09-24 14:50:45 +08:00

collect_env.py

【FastDeploy CLI】collect-env subcommand (#4044)

2025-09-15 10:31:23 +08:00

config.py

Support limit thinking lengths (#4069)

2025-09-25 19:55:56 +08:00

envs.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00