Zero Rains 850c9d98d4 [BugFix] Add prefill restrictions for chunked_prefill+VL (#2983)

2025-07-23 01:45:57 -07:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_worker.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

gcu_model_runner.py

delete max-len (#2959)

2025-07-23 15:11:39 +08:00

gcu_worker.py

[Feature] Support using prefix-caching + cudagraph for inference (#2924)

2025-07-22 00:59:45 -07:00

gpu_model_runner.py

[BugFix] Add prefill restrictions for chunked_prefill+VL (#2983)

2025-07-23 01:45:57 -07:00

gpu_worker.py

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00

iluvatar_model_runner.py

[Feature] Support using prefix-caching + cudagraph for inference (#2924)

2025-07-22 00:59:45 -07:00

iluvatar_worker.py

[Feature] Support using prefix-caching + cudagraph for inference (#2924)

2025-07-22 00:59:45 -07:00

model_runner_base.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

output.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker_base.py

[Feature] Support using prefix-caching + cudagraph for inference (#2924)

2025-07-22 00:59:45 -07:00

worker_process.py

[BugFix] Add prefill restrictions for chunked_prefill+VL (#2983)

2025-07-23 01:45:57 -07:00

xpu_model_runner.py

delete max-len (#2959)

2025-07-23 15:11:39 +08:00

xpu_worker.py

[Feature] Support using prefix-caching + cudagraph for inference (#2924)

2025-07-22 00:59:45 -07:00