xiaolei373 55124f8491 Add cli run batch (#4237) ...

* feat(log):add_request_and_response_log

* [cli] add run batch cli

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-09-26 14:27:25 +08:00

..

ce

fix typos (#4176)

2025-09-22 14:27:17 +08:00

ci_use

[Feature] add config api (#4254)

2025-09-26 11:21:02 +08:00

distributed

fix typos (#4176)

2025-09-22 14:27:17 +08:00

e2e

Support limit thinking lengths (#4069)

2025-09-25 19:55:56 +08:00

entrypoints

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00

graph_optimization

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

input

[fix]update apply_chat_template (#4137)

2025-09-24 18:56:32 +08:00

layers

【FIX】Change the name of sparse attn from moba to plas (#4006) (#4076)

2025-09-23 10:26:40 +08:00

logger

fix test name (#3493)

2025-08-22 23:43:47 +08:00

metrics

[metrics] Add serveral observability metrics (#3868)

2025-09-08 14:13:13 +08:00

model_executor

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

model_loader

[v1 loader]code style (#4204)

2025-09-23 19:36:00 +08:00

operators

【Hackathon 9th No.21、23】add unit tests for fused_hadamard_quant_fp8, moe_fused_hadamard_quant_fp8 (#4094)

2025-09-25 12:15:00 +08:00

output

fix typos (#4093)

2025-09-15 18:33:30 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

pooling

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

[Supplements and upgrades]Improvement of X1 parsers (#4172)

2025-09-26 13:37:37 +08:00

utils

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00

v1

fix unittest (#4155)

2025-09-17 20:20:26 +08:00

conftest.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

cov_pytest.ini

[CI] enhance clean port and add waiting time (#4152)

2025-09-17 20:31:49 +08:00

utils.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00