Yonghua Li cead6b26fa [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#4993) ...

* [update] update time_to_first_tokens to include queue time, and remove first_token_latency and infer_latency

* [doc] update docs

* [ci] fix test

* [chore] delete redundant code

---------

Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>

2025-11-26 14:42:17 +08:00

..

assets/images

更新文档 (#3975)

2025-09-08 16:53:37 +08:00

best_practices

remove load default_v1 since already been as default (#4980)

2025-11-12 16:49:48 +08:00

cli

[docs] add cli uasge to docs (#4569)

2025-10-28 10:35:11 +08:00

features

[PD Disaggregation] remove splitwise deployment on single node and refine the code (#4891)

2025-11-14 09:56:53 +08:00

get_started

[Docs] add docs of base64 or local file mm inputs (#5193)

2025-11-26 14:41:43 +08:00

online_serving

[Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#4993)

2025-11-26 14:42:17 +08:00

quantization

[Docx] add language (en/cn) switch links (#4470)

2025-10-17 15:47:41 +08:00

usage

[XPU][Docs]Update document (#5091)

2025-11-19 10:20:14 +08:00

zh

[Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#4993)

2025-11-26 14:42:17 +08:00

benchmark.md

[Docx] add language (en/cn) switch links (#4470)

2025-10-17 15:47:41 +08:00

index.md

[Docs] add doc for glm (#4933)

2025-11-10 21:21:33 +08:00

offline_inference.md

update doc (#4675)

2025-10-30 11:19:04 +08:00

parameters.md

[TSP] Support qwen3 moe tsp + cudagraph (#4871)

2025-11-10 23:37:51 +08:00

requirements.txt

fix: correct typo in nvidia_gpu.md (#4848)

2025-11-06 16:03:02 +08:00

supported_models.md

remove load default_v1 since already been as default (#4980)

2025-11-12 16:49:48 +08:00