GoldPancake e56c4dd0a8 [Cherry-Pick] Support for request-level speculative decoding metrics monitoring.(#5518) (#5614) ...

* support spec metrics monitor per request

2025-12-17 20:53:04 +08:00

..

tool_parsers

[CI] Add Unittest (#5187)

2025-11-25 11:00:34 +08:00

test_api_authentication.py

[Feature] Enable FastDeploy to support adding the “--api-key” authentication parameter. (#4806)

2025-11-08 18:24:02 +08:00

test_build_sample_logprobs.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00

test_chatcompletion_request.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00

test_completion_echo.py

[Cherry-Pick] Support for request-level speculative decoding metrics monitoring.(#5518) (#5614)

2025-12-17 20:53:04 +08:00

test_dealer_connection_manager.py

[Feature] add dealer manager to reuse the connection (#3471)

2025-08-21 13:11:13 +08:00

test_error_response.py

[format] Valid para format error info (#4035)

2025-09-12 19:05:17 +08:00

test_finish_reason.py

[BugFix] unify max_tokens (#4968)

2025-11-18 20:01:33 +08:00

test_max_streaming_tokens.py

[Cherry-Pick] Support for request-level speculative decoding metrics monitoring.(#5518) (#5614)

2025-12-17 20:53:04 +08:00

test_metrics_routes.py

[BugFix][Metrics] Fix Prometheus Multiprocess Metrics Issues and Add ZMQ Communication Metrics (#5185)

2025-11-27 15:05:09 +08:00

test_multi_api_server.py

[CI] add multi api server test (#4049)

2025-09-12 11:18:38 +08:00

test_response_processors.py

[Feature] support audio tts (#5333)

2025-12-03 21:06:48 +08:00

test_run_batch_proto.py

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00

test_run_batch_subcommand.py

Add cli run batch (#4237)

2025-09-26 14:27:25 +08:00

test_run_batch.py

[CI]add clear to run-batch ci (#5307)

2025-12-01 21:18:19 +08:00

test_serving_chat.py

add detoken switch (#5463) (#5572)

2025-12-17 17:04:45 +08:00

test_serving_completion.py

[Cherry-Pick] Support for request-level speculative decoding metrics monitoring.(#5518) (#5614)

2025-12-17 20:53:04 +08:00

test_serving_embedding.py

feat: add post-processing step for pool_output (#4462)

2025-10-21 20:24:26 +08:00

test_serving_models.py

[Optimize]Error messages about Model api. (#3839)

2025-09-08 15:52:26 +08:00

test_serving_reward.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00

test_usage_calculator.py

feat: add support for API usage with multimodal models (#4548)

2025-10-28 20:23:46 +08:00

test_wrap_streaming_generator.py

[Feature] Enable FastDeploy to support adding the “--api-key” authentication parameter. (#4806)

2025-11-08 18:24:02 +08:00