Yonghua Li 3672afb487 [Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076) ...

* [update] update time_to_first_tokens to include queue time, and remove first_token_latency and infer_latency

* [doc] update docs

* [ci] fix test

2025-11-18 14:38:59 +08:00

..

cache_manager

[Bug fix] Robust cache messager send cache when send cache slower than prefill (#4659)

2025-11-03 16:37:13 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

entrypoints

[BugFix] fix work metrics not returned by metrics api (#4921)

2025-11-12 17:11:40 +08:00

input

Support limit thinking lengths (#4244)

2025-09-24 17:30:53 +08:00

inter_communicator

[Optimize] Improve perf for fd response token with internal adapter (#4947)

2025-11-12 16:02:07 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

model_executor

[Bug fix] Fix x1 thinking label bug (#4434)

2025-10-15 19:03:41 +08:00

multimodal

[MTP]Support mtp reshard (#4099)

2025-09-15 17:13:53 +08:00

output

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

platforms

Revert "【FIX】Change the name of sparse attn from moba to plas (#3845)" (#4001)

2025-09-09 11:08:23 +08:00

plugins

Each module should have its own plugins_loaded (#4164)

2025-09-19 14:06:10 +08:00

reasoning

[CUDAGraph] Support multi output buffers and merge some fixes from feature/exp_0908 (#4062)

2025-09-15 16:21:30 +08:00

rl

[NewFeture]add ep rollout model init and update/clear ep buffer (#4039)

2025-09-17 20:24:53 +08:00

scheduler

[Bug fix] Fix decoding speed slowly bug in 20250922 (#5101)

2025-11-18 14:38:38 +08:00

spec_decode

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

splitwise

[Optimize] Improve perf for fd response token with internal adapter (#4947)

2025-11-12 16:02:07 +08:00

transformer_utils

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

worker

fix bug for support enable thinking and not in a batch (#4331)

2025-10-13 10:39:10 +08:00

__init__.py

[BugFix] fix work metrics not returned by metrics api (#4921)

2025-11-12 17:11:40 +08:00

collect_env.py

【FastDeploy CLI】collect-env subcommand (#4044)

2025-09-15 10:31:23 +08:00

config.py

Support limit thinking lengths (#4244)

2025-09-24 17:30:53 +08:00

envs.py

Fix env setting for unify code 20250922 (#4994)

2025-11-12 20:51:38 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00