Yonghua Li c5510e9b43 [Metrics] move prompt_tokens_total to main process metrics (#5118) ...

* [update] move prompt_tokens_total to main process metrics

* [update] move again from zmq thread to scheduler

2025-11-19 14:12:15 +08:00

..

cache_manager

[Bug fix] Robust cache messager send cache when send cache slower than prefill (#4659)

2025-11-03 16:37:13 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

[Metrics] move prompt_tokens_total to main process metrics (#5118)

2025-11-19 14:12:15 +08:00

entrypoints

[Metrics] move prompt_tokens_total to main process metrics (#5118)

2025-11-19 14:12:15 +08:00

input

Support limit thinking lengths (#4244)

2025-09-24 17:30:53 +08:00

inter_communicator

[Optimize] Improve perf for fd response token with internal adapter (#4947)

2025-11-12 16:02:07 +08:00

logger

…

metrics

[Metrics] move prompt_tokens_total to main process metrics (#5118)

2025-11-19 14:12:15 +08:00

model_executor

[Bug fix] Fix x1 thinking label bug (#4434)

2025-10-15 19:03:41 +08:00

multimodal

[MTP]Support mtp reshard (#4099)

2025-09-15 17:13:53 +08:00

output

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

platforms

Revert "【FIX】Change the name of sparse attn from moba to plas (#3845)" (#4001)

2025-09-09 11:08:23 +08:00

plugins

Each module should have its own plugins_loaded (#4164)

2025-09-19 14:06:10 +08:00

reasoning

[CUDAGraph] Support multi output buffers and merge some fixes from feature/exp_0908 (#4062)

2025-09-15 16:21:30 +08:00

rl

[NewFeture]add ep rollout model init and update/clear ep buffer (#4039)

2025-09-17 20:24:53 +08:00

scheduler

[Bug fix] Fix decoding speed slowly bug in 20250922 (#5101)

2025-11-18 14:38:38 +08:00

spec_decode

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

splitwise

[Optimize] Improve perf for fd response token with internal adapter (#4947)

2025-11-12 16:02:07 +08:00

transformer_utils

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

worker

fix bug for support enable thinking and not in a batch (#4331)

2025-10-13 10:39:10 +08:00

__init__.py

[BugFix] fix work metrics not returned by metrics api (#4921)

2025-11-12 17:11:40 +08:00

collect_env.py

【FastDeploy CLI】collect-env subcommand (#4044)

2025-09-15 10:31:23 +08:00

config.py

Support limit thinking lengths (#4244)

2025-09-24 17:30:53 +08:00

envs.py

Fix env setting for unify code 20250922 (#4994)

2025-11-12 20:51:38 +08:00

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00