Yonghua Li 3672afb487 [Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076) ...

* [update] update time_to_first_tokens to include queue time, and remove first_token_latency and infer_latency

* [doc] update docs

* [ci] fix test

2025-11-18 14:38:59 +08:00

..

ce

fix typos (#4176)

2025-09-22 14:27:17 +08:00

ci_use

Support limit thinking lengths (#4244)

2025-09-24 17:30:53 +08:00

distributed

fix typos (#4176)

2025-09-22 14:27:17 +08:00

e2e

Support limit thinking lengths (#4244)

2025-09-24 17:30:53 +08:00

entrypoints

fix_unitest (#4159)

2025-09-18 11:17:15 +08:00

graph_optimization

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

input

[fix]Modify follow-up push parameters and Modify the verification method for thinking length (#4086)

2025-09-19 14:26:01 +08:00

layers

fix dynamic Cfp8 computing error (#4119)

2025-09-16 20:21:49 +08:00

logger

fix test name (#3493)

2025-08-22 23:43:47 +08:00

metrics

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

model_executor

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

model_loader

[CI] enhance clean port and add waiting time (#4152)

2025-09-17 20:31:49 +08:00

operators

【Hackathon 9th No.30】add test_tritonmoe_preprocess (#3891)

2025-09-22 15:31:32 +08:00

output

fix typos (#4093)

2025-09-15 18:33:30 +08:00

platforms

【Hackathon 9th No.70】supplementary unit test for CPUPlatform and CUDAPlatform (#3580)

2025-08-29 10:34:05 +08:00

plugins

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

pooling

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

quantization

[BugFix]Fix load kv cache quant scale (#4077)

2025-09-12 17:44:03 +08:00

reasoning

【Hackathon 9th No.84】Supplementary Unit Test for fastdeploy/reasoning (#3570)

2025-09-03 10:55:02 +08:00

utils

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

v1

fix unittest (#4155)

2025-09-17 20:20:26 +08:00

conftest.py

[v1 loader]qwen Offline fp8 (#4036)

2025-09-15 13:44:11 +08:00

cov_pytest.ini

[CI] enhance clean port and add waiting time (#4152)

2025-09-17 20:31:49 +08:00

utils.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00