chenjian 3ea1b44a58 [Optimization] Improve perf for fd response token with internal adapter (#4992) ...

* [Optimize] Improve perf for fd response token with internal adapter

* fix

* fix bug

* fix ci

* fix ci

* fix ci

* fix ci

2025-11-21 19:02:03 +08:00

..

__init__.py

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

engine_cache_queue.py

[Feature] EngineWorkerQueue anonymous port (#4597)

2025-10-28 10:22:37 +08:00

engine_worker_queue.py

[Feature] support async download features (#5003)

2025-11-19 22:23:36 +08:00

ipc_signal_const.py

[feat] support prefix cache clearing when /clear_load_weight is called (#4008)

2025-09-28 19:42:53 +08:00

ipc_signal.py

[BugFix] Fix profile run in pd-disaggregated deployment (#4584)

2025-10-31 14:42:00 +08:00

zmq_client.py

[Perf] Support tensor transmission between work and engine with zero-copy to improve efficiency (#4839)

2025-11-11 15:43:11 +08:00

zmq_server.py

[Optimization] Improve perf for fd response token with internal adapter (#4992)

2025-11-21 19:02:03 +08:00