Sunny-bot1 930f7b781c [Optimization] Put get_block_shape_and_split_kv_block in cuda graph for append attention backend (#4443) ...

* get block in cuda graph

* fix sot

2025-10-17 10:59:56 +08:00

..

graph_optimization

[CUDAGraph]Add support for custom all-reduce operators under SOT mode (#4386)

2025-10-16 19:31:19 +08:00

guided_decoding

[FDConfig]Remove reasoning_parser/guided_decoding_backend/disable_any_whitespace/device_ids in FDConfig (#4362)

2025-10-17 10:40:59 +08:00

layers

[Optimization] Put get_block_shape_and_split_kv_block in cuda graph for append attention backend (#4443)

2025-10-17 10:59:56 +08:00

model_loader

[v1 loader]code style (#4204)

2025-09-23 19:36:00 +08:00

models

[FDConfig]Remove max_model_len in FDConfig (#4350)

2025-10-11 14:04:17 +08:00

ops

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

forward_meta.py

[Optimization] Fuse get_max_len and get_kv_max_len (#4369)

2025-10-13 20:35:00 +08:00

load_weight_utils.py

[v1 loader]code style (#4204)

2025-09-23 19:36:00 +08:00

pre_and_post_process.py

perf: optimize ZMQ communication with async queue and single-threaded… (#4444)

2025-10-16 15:46:26 +08:00

utils.py

V1 loader default (#4251)

2025-10-15 16:49:17 +08:00