Yonghua Li c5510e9b43 [Metrics] move prompt_tokens_total to main process metrics (#5118) ...

* [update] move prompt_tokens_total to main process metrics

* [update] move again from zmq thread to scheduler

2025-11-19 14:12:15 +08:00

..

sched

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Feature] Support pd ep deployment with yiyan adapter (#4029)

2025-09-22 16:41:38 +08:00

common_engine.py

[Metrics] move prompt_tokens_total to main process metrics (#5118)

2025-11-19 14:12:15 +08:00

engine.py

[Optimize] Improve perf for fd response token with internal adapter (#4947)

2025-11-12 16:02:07 +08:00

expert_service.py

[Optimize] Improve perf for fd response token with internal adapter (#4947)

2025-11-12 16:02:07 +08:00

kv_cache_interface.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooling_params.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

request.py

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

resource_manager.py

[Cherry-Pick] support model_id as metric labels by redefining metric update interface (#4480)

2025-10-20 16:11:19 +08:00

sampling_params.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

tasks.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00