chenjian 0d7f29841d [Cherry-pick] Fix bug in develop for eb5 (#4845) ...

* fix bug for PD EP

* fix

* optimize perf for engine worker queue

* fix bug

* fix internode ll two stage

* fix for ci

2025-11-06 14:01:42 +08:00

..

transfer_factory

c++ code format (#4527)

2025-10-22 17:59:50 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_data.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

cache_messager.py

[Cherry-pick] Fix bug in develop for eb5 (#4845)

2025-11-06 14:01:42 +08:00

cache_metrics.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

cache_transfer_manager.py

[fix] remove cache tensor creation for cache_transfer_manager (#4420)

2025-10-20 16:19:56 +08:00

multimodal_cache_manager.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

ops.py

[XPU] abstract a hardware-agnostic operator wrapper for prefix cache and specify xpu device id definition (#4455)

2025-10-17 14:05:33 +08:00

prefix_cache_manager.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00