Nyakku Shigure 48e6a0ca26 [SOT] Mark dynamic dims by type annotations (#2771) ...

* [SOT] Mark dynamic dims by type annotations

* fix conflict of forward_meta

* mark more attn backend

* fix missing annotated and add env SOT_SPECIALIZED_DIM_NUMBERS

* auto infer implicit 0 dim dynamic dim

* revert manual marked dims

* revert missing update

* auto infer can use unsafe code in warmup stage

* check -> type_match

* fix codestyle

* restore blank line

* empty commit

* add need_warmup nonlocal;

* add doc for resolver

* add missing type hints

* unquote "ForwardMeta"

2025-07-22 00:23:52 -07:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

custom all reduce support cuda graph (#2938)

2025-07-21 22:52:03 +08:00

decorator.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

graph_optimization_backend.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00