Commit Graph

6 Commits

Author SHA1 Message Date
ming1753
7c72383efa [BugFix] fix decode time sleep bug (#5461)
* [BugFix] fix decode time sleep bug

* format
2025-12-10 15:48:48 +08:00
ming1753
70ec1e17c1 [Features] add audio request & fix embedding bug (#5201)
* [Features] add audio request & fix embedding bug

* fix bug
2025-12-01 11:12:17 +08:00
yangjianfengo1
af715db763 [Scheduler] Support chunk prefill for video input (#5107)
* add video chunk prefill

* add vit_merge=True for test_tokenizer_client.py

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
2025-11-20 16:29:13 +08:00
RichardWooSJTU
5a8c60454e [BugFix] Fix decode_type which has been deleted in req and optimize token client retry scheme (#4564) 2025-10-23 05:08:10 -07:00
RichardWooSJTU
3740e33fea 【Feature】ResourceManagerV1 support need block num notifying (#4220)
* support need block num notifying

* adapt t2i

* fix unexpected change
2025-09-29 11:11:51 +08:00
SunLei
b9af95cf1c [Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)
* [Feature] add AsyncTokenizerClient

* add decode_image

* Add response_processors with remote decode support.

* [Feature] add tokenizer_base_url startup argument

* Revert comment removal and restore original content.

* [Feature] Non-streaming requests now support remote image decoding.

* Fix parameter type issue in decode_image call.

* Keep completion_token_ids when return_token_ids = False.

* add copyright
2025-08-30 17:06:26 +08:00