lizexu123 bc0b92bba4 [BugFix] support real batch_size (#3109) (#3217) ...

* support real bsz

* fix

* fix xpu_model_runner.py,gpu_model_runner.py,gcu_model_runner.py,iluvatar_model_runner.py

* add event_loop_ep

* fix

* Add comments

* fix

* support mtp real_batch_size

* fix

* self.tmp_seq_lens_this_time->self.seq_lens_this_time_buffer

* fix

* fix VL real_seq_lens_this_time

* fix

* fix mtp

* fix

* fix mtp

* fix xpu

* fix

2025-08-06 14:30:33 +08:00

..

cache_manager

Update cache_messager.py (#3173)

2025-08-04 15:09:17 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

update flake8 version to support pre-commit in python3.12 (#3000)

2025-07-24 01:43:31 -07:00

engine

fix request_output sampling_params (#3154)

2025-08-01 22:34:33 +08:00

entrypoints

[Bugfix] Fix uninitialized decoded_token and add corresponding unit test (#3201)

2025-08-05 10:55:22 +08:00

input

[Feature] Multimodal Scheduler V1 (#3019)

2025-07-30 16:05:55 +08:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

model_executor

[Bug Fix] Fix bug of MLA Attention Backend (#3178)

2025-08-05 10:53:27 +08:00

output

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

reasoning

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rl

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

[BugFix] support real batch_size (#3109) (#3217)

2025-08-06 14:30:33 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

[BugFix] support real batch_size (#3109) (#3217)

2025-08-06 14:30:33 +08:00

__init__.py

[Fix] Fix version function (#3076)

2025-07-30 16:05:24 +08:00

config.py

[BugFix]Fix ep size (#3092)

2025-07-30 21:03:12 +08:00

envs.py

[Feature] multi source download (#3005)

2025-07-24 17:42:09 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Fix] Fix version function (#3076)

2025-07-30 16:05:24 +08:00