Ryan 95b5af24db [SOT] Add sot warmup (NVIDIA GPU Only) (#2929) ...

* add sot warmup

* fix code style

* change batch_size list

* add param to config

* rm free_list settings && set sot_warmup_sizes

* finish debug with dynamic dims by type annotations

* add profile_run guard

* rm sth useless

2025-07-22 21:36:14 +08:00

..

cache_manager

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

custom all reduce support cuda graph (#2938)

2025-07-21 22:52:03 +08:00

engine

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00

entrypoints

[fix] non-streaming api now returns full output ids if return_token_ids is enabled (#2951)

2025-07-22 14:35:56 +08:00

input

[FIX]fix rejection sampling when topp=0 using _SAMPLING_EPS (#2967)

2025-07-22 05:53:37 -07:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

model_executor

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00

output

[Feature][MTP]Support multi-step MTP (#2952)

2025-07-22 16:26:29 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

reasoning

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rl

fix rl config local rank (#2957)

2025-07-22 04:39:54 -07:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

[MTP Fix] Fix code and register cpp operators (#2965)

2025-07-22 19:36:24 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

config.py

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00

envs.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00