copilot-swe-agent[bot] e09d6363d3 Add signal handlers for graceful process termination ...

- Added SIGINT/SIGTERM signal handlers in api_server.py (both OpenAI and simple versions)
- Added cleanup_processes() function to properly terminate worker processes
- Enhanced StandaloneApplication with worker exit hooks and cleanup
- Added signal handling in worker_process.py for graceful worker shutdown
- Added shutdown_event to coordinate graceful shutdown across threads
- Improved worker monitor to respect shutdown event

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-12-23 12:10:20 +00:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

dcu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

gcu_model_runner.py

[Feature] [PD Disaggregation] simplify configuration for pd-disaggregated deployment, and refactor post-init and usage for all ports (#5415)

2025-12-17 15:50:42 +08:00

gcu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

gpu_model_runner.py

[Speculative Decoding]Support multi-step mtp with cudagraph (#5624)

2025-12-22 11:34:04 +08:00

gpu_worker.py

[Graph Optimization][CINN] Use CINN in PaddleOCR-VL ViT part (#5223)

2025-12-09 14:37:00 +08:00

hpu_model_runner.py

[Intel HPU] enable kv cache scheduler v1 for hpu (#5648)

2025-12-19 12:03:39 +08:00

hpu_worker.py

[Intel HPU] enable kv cache scheduler v1 for hpu (#5648)

2025-12-19 12:03:39 +08:00

iluvatar_model_runner.py

[Iluvatar] Support V1_KVCACHE_SCHEDULER and paddleocr-vl rope mode (#5555)

2025-12-18 02:14:25 -08:00

iluvatar_worker.py

Revert "[Optim] Remove limitation of number of kvcache blocks (#5612)" (#5702)

2025-12-23 15:41:33 +08:00

metax_model_runner.py

[Metax] fix metax runner issue (#5629)

2025-12-17 21:32:54 -08:00

metax_worker.py

[Metax] optimize mla attention (#5258)

2025-12-09 11:18:19 +08:00

model_runner_base.py

[Graph Optimization][CINN] Use CINN in PaddleOCR-VL ViT part (#5223)

2025-12-09 14:37:00 +08:00

output.py

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

tbo.py

[Others] update tbo related code (#5485)

2025-12-11 12:34:46 +08:00

worker_base.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

worker_process.py

Add signal handlers for graceful process termination

2025-12-23 12:10:20 +00:00

xpu_model_runner.py

[XPU]Set top_p=0.0 by default on XPU to optimize performance (#5686)

2025-12-23 11:01:01 +08:00

xpu_worker.py

[xpu] support mtp for xpu(mix) (#5274)

2025-12-01 11:03:14 +08:00