lizexu123 a053ab889b [BugFix] fix num_running_requests in cuda_graph (#3457) ...

* fix cuda_grpah

* add note

---------

Co-authored-by: RAM <gstian5555@outlook.com>

2025-08-19 10:47:22 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_worker.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

gcu_model_runner.py

[Code Simplification] remove cum_offsets (#3410)

2025-08-18 20:21:25 +08:00

gcu_worker.py

[Feature] support seed parameter (#3161)

2025-08-06 15:20:47 +08:00

gpu_model_runner.py

[BugFix] fix num_running_requests in cuda_graph (#3457)

2025-08-19 10:47:22 +08:00

gpu_worker.py

delete parallel_state.py (#3250)

2025-08-08 11:03:29 +08:00

iluvatar_model_runner.py

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

iluvatar_worker.py

[Iluvatar GPU] Modify the names of some variables (#3273)

2025-08-13 11:38:02 +08:00

metax_model_runner.py

[MetaxGPU] Support FastDeploy on metax gpu (#3241)

2025-08-13 11:11:54 +08:00

metax_worker.py

[MetaxGPU] Support FastDeploy on metax gpu (#3241)

2025-08-13 11:11:54 +08:00

model_runner_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

output.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

worker_process.py

[BugFix] fix real_bsz in ep (#3366)

2025-08-14 17:31:19 +08:00

xpu_model_runner.py

[OPs] Universal optimization and Fix early_stop cuda 700 (#3375)

2025-08-14 22:40:44 +08:00

xpu_worker.py

[Feature] support seed parameter (#3161)

2025-08-06 15:20:47 +08:00