Juncai 08ca0f6aea [Feature] [PD] add simple router and refine splitwise deployment (#4709) ...

* add simple router and refine splitwise deployment

* fix

2025-11-06 14:56:02 +08:00

..

transfer_factory

c++ code format (#4527)

2025-10-22 17:59:50 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_data.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

cache_messager.py

[Feature] [PD] add simple router and refine splitwise deployment (#4709)

2025-11-06 14:56:02 +08:00

cache_metrics.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

cache_transfer_manager.py

[fix] remove cache tensor creation for cache_transfer_manager (#4420)

2025-10-20 16:19:56 +08:00

multimodal_cache_manager.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

ops.py

[XPU] abstract a hardware-agnostic operator wrapper for prefix cache and specify xpu device id definition (#4455)

2025-10-17 14:05:33 +08:00

prefix_cache_manager.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00