Daci 5fc12eddfe [Optimization] xgrammar async compile, multi thread, speed up (#4835) ...

* xgrammar async compile, multi thread, speed up

* fix test_sampler.py & pre-commit err

* add redis version check && fix request.llm_engine_recv_req_timestamp

* xgrammar prefill & decode & v0

* fix test_gpu_prompt_logprobs.py

* add test_guided_decoding.py

* Update fastdeploy/scheduler/splitwise_scheduler.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update fastdeploy/model_executor/guided_decoding/xgrammar_backend.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update fastdeploy/model_executor/guided_decoding/xgrammar_backend.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix torch xgrammar unittest env

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

2025-11-14 18:05:26 +08:00

..

kernels

[Feature] mm and thinking model support structred output (#2749)

2025-09-02 16:21:09 +08:00

__init__.py

[FDConfig]Remove reasoning_parser/guided_decoding_backend/disable_any_whitespace/device_ids in FDConfig (#4362)

2025-10-17 10:40:59 +08:00

base_guided_decoding.py

[Optimization] xgrammar async compile, multi thread, speed up (#4835)

2025-11-14 18:05:26 +08:00

ernie_tokenizer.py

rename ernie_xxx to ernie4_5_xxx (#3621)

2025-08-26 19:29:27 +08:00

xgrammar_backend.py

[Optimization] xgrammar async compile, multi thread, speed up (#4835)

2025-11-14 18:05:26 +08:00