Nyakku Shigure 48e6a0ca26 [SOT] Mark dynamic dims by type annotations (#2771) ...

* [SOT] Mark dynamic dims by type annotations

* fix conflict of forward_meta

* mark more attn backend

* fix missing annotated and add env SOT_SPECIALIZED_DIM_NUMBERS

* auto infer implicit 0 dim dynamic dim

* revert manual marked dims

* revert missing update

* auto infer can use unsafe code in warmup stage

* check -> type_match

* fix codestyle

* restore blank line

* empty commit

* add need_warmup nonlocal;

* add doc for resolver

* add missing type hints

* unquote "ForwardMeta"

2025-07-22 00:23:52 -07:00

..

cache_manager

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

custom all reduce support cuda graph (#2938)

2025-07-21 22:52:03 +08:00

engine

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

entrypoints

[fix] non-streaming api now returns full output ids if return_token_ids is enabled (#2951)

2025-07-22 14:35:56 +08:00

input

[fix] non-streaming api now returns full output ids if return_token_ids is enabled (#2951)

2025-07-22 14:35:56 +08:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

model_executor

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

output

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

platforms

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

reasoning

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rl

support trainer_degree in name_mapping (#2935)

2025-07-20 23:12:55 -07:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

remove cum_offsets from ForwardMeta (#2925)

2025-07-19 23:57:27 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

config.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

envs.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00