SunLei 3098aee05f [Perf] Support tensor transmission between work and engine with zero-copy to improve efficiency (#4839) ...

* feat(zmq): support tensor transmission with zero-copy for improved efficiency

* perf: zmq.send disable copy

* zmq recv data for debug

* convert logprobs tensor to cpu

2025-11-11 15:43:11 +08:00

..

graph_optimization

[Iluvatar] add vl into ci and support v1 loader (#4774)

2025-11-11 10:50:17 +08:00

guided_decoding

[FDConfig]Remove reasoning_parser/guided_decoding_backend/disable_any_whitespace/device_ids in FDConfig (#4362)

2025-10-17 10:40:59 +08:00

layers

[Perf] Support tensor transmission between work and engine with zero-copy to improve efficiency (#4839)

2025-11-11 15:43:11 +08:00

logits_processor

[Feature] support logits processors (#4515)

2025-10-29 00:08:53 +08:00

model_loader

[Speculative Decoding][MTP]Support mtp in epdptp mode (#4614)

2025-10-28 16:02:47 +08:00

models

add tie_word_embeddings for lmhead (#4916)

2025-11-11 10:46:35 +08:00

ops

delete useless code (#4544)

2025-10-23 13:40:34 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

forward_meta.py

remove input_ids from ForwardMeta (#4793)

2025-11-05 11:55:51 +08:00

load_weight_utils.py

[TSP] Support qwen3 moe tsp + cudagraph (#4871)

2025-11-10 23:37:51 +08:00

pre_and_post_process.py

[Iluvatar] add vl into ci and support v1 loader (#4774)

2025-11-11 10:50:17 +08:00

utils.py

[Iluvatar] add vl into ci and support v1 loader (#4774)

2025-11-11 10:50:17 +08:00