lizexu123 b01cfd6007 [BugFix] support real batch_size (#3109) ...

* support real bsz

* fix

* fix xpu_model_runner.py,gpu_model_runner.py,gcu_model_runner.py,iluvatar_model_runner.py

* add event_loop_ep

* fix

* Add comments

* fix

* support mtp real_batch_size

* fix

* self.tmp_seq_lens_this_time->self.seq_lens_this_time_buffer

* fix

* fix VL real_seq_lens_this_time

* fix

* fix mtp

* fix

* fix mtp

* fix xpu

* fix

2025-08-05 16:33:54 +08:00

..

__init__.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

mtp.py

[BugFix] support real batch_size (#3109)

2025-08-05 16:33:54 +08:00

ngram.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00