lddfym 2056a428bd [bug fix] Fix the placeholder in qwen prompt and add some unittests (#4065) ...

* fix the placeholder in qwen prompt

* fix the placeholder in qwen prompt

* add soem unittests for qwen_vl_processor

2025-09-11 20:00:02 +08:00

..

ernie4_5_vl_processor

delete ernie4_5_vl_tokenizer (#3631)

2025-08-27 20:36:02 +08:00

qwen_vl_processor

[bug fix] Fix the placeholder in qwen prompt and add some unittests (#4065)

2025-09-11 20:00:02 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

ernie4_5_processor.py

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

ernie4_5_tokenizer.py

delete ernie4_5_vl_tokenizer (#3631)

2025-08-27 20:36:02 +08:00

preprocess.py

add reasoning parser plugin (#3811)

2025-09-03 18:31:27 +08:00

text_processor.py

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

tokenzier_client.py

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

utils.py

rename ernie_xxx to ernie4_5_xxx (#3621)

2025-08-26 19:29:27 +08:00