Yonghua Li 3672afb487 [Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076) ...

* [update] update time_to_first_tokens to include queue time, and remove first_token_latency and infer_latency

* [doc] update docs

* [ci] fix test

2025-11-18 14:38:59 +08:00

..

assets/images

更新文档 (#3975)

2025-09-08 16:53:37 +08:00

best_practices

add a3b-thinking doc (#3994)

2025-09-09 10:27:01 +08:00

features

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

get_started

fix typos (#4176)

2025-09-22 14:27:17 +08:00

online_serving

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

quantization

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

usage

fix typos (#4176)

2025-09-22 14:27:17 +08:00

zh

[Cherry-Pick] [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#5076)

2025-11-18 14:38:59 +08:00

benchmark.md

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

index.md

更新文档 (#3998)

2025-09-09 10:44:15 +08:00

offline_inference.md

rename ernie_xxx to ernie4_5_xxx (#3621)

2025-08-26 19:29:27 +08:00

parameters.md

更新文档 (#3975)

2025-09-08 16:53:37 +08:00

requirements.txt

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

supported_models.md

Update docs for thinking model support

2025-09-09 10:08:05 +08:00