lizexu123 b01cfd6007 [BugFix] support real batch_size (#3109) ...

* support real bsz

* fix

* fix xpu_model_runner.py,gpu_model_runner.py,gcu_model_runner.py,iluvatar_model_runner.py

* add event_loop_ep

* fix

* Add comments

* fix

* support mtp real_batch_size

* fix

* self.tmp_seq_lens_this_time->self.seq_lens_this_time_buffer

* fix

* fix VL real_seq_lens_this_time

* fix

* fix mtp

* fix

* fix mtp

* fix xpu

* fix

2025-08-05 16:33:54 +08:00

..

cache_manager

Update cache_messager.py (#3172)

2025-08-04 14:32:34 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00

engine

Update engine.py

2025-08-05 16:10:36 +08:00

entrypoints

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

input

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

model_executor

fix lm head bias (#3185)

2025-08-05 15:40:24 +08:00

multimodal

[Feature] remove dependency on enable_mm and refine multimodal's code (#3014)

2025-08-01 20:01:18 +08:00

output

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

plugins

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

reasoning

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rl

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

[BugFix] support real batch_size (#3109)

2025-08-05 16:33:54 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

[BugFix] support real batch_size (#3109)

2025-08-05 16:33:54 +08:00

__init__.py

【Feature】add fd plugins && rm model_classes (#3123)

2025-08-03 19:53:20 -07:00

config.py

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

envs.py

【Feature】add fd plugins && rm model_classes (#3123)

2025-08-03 19:53:20 -07:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Feature] remove dependency on enable_mm and refine multimodal's code (#3014)

2025-08-01 20:01:18 +08:00