李泳桦 d18a637a17 [feat] add metrics for yiyan adapter (#3219) ...

* [feat] add metrics for yiyan adapter

* [fix] fix metrics num_requests_waiting and num_requests_running

* [fix] fix metrics gpu_cache_usage_perc

* [refactor] change where requests_number increases

* [chore] rename xxx_block_num as xxx_gpu_block_num, and update their values accordingly

* [chore] delete useless code

2025-08-21 16:58:10 +08:00

..

transfer_factory

fix cache messager bug when d restart (#3386)

2025-08-14 11:43:59 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_data.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_messager.py

[Bug fix] Fix bug for d blocks not enough (#3479)

2025-08-21 11:36:16 +08:00

cache_metrics.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_transfer_manager.py

[Bug fix] Fix memory allocation (#3475)

2025-08-19 19:48:24 +08:00

prefix_cache_manager.py

[feat] add metrics for yiyan adapter (#3219)

2025-08-21 16:58:10 +08:00