SunLei 3098aee05f [Perf] Support tensor transmission between work and engine with zero-copy to improve efficiency (#4839) ...

* feat(zmq): support tensor transmission with zero-copy for improved efficiency

* perf: zmq.send disable copy

* zmq recv data for debug

* convert logprobs tensor to cpu

2025-11-11 15:43:11 +08:00

..

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooler.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

stream_transfer_data.py

[Feature][Executor] GPU Model Runner Supports prompt_logprobs and max_logprobs (#4769)

2025-11-05 10:43:25 +08:00

token_processor.py

[Perf] Support tensor transmission between work and engine with zero-copy to improve efficiency (#4839)

2025-11-11 15:43:11 +08:00