yangjianfengo1 3754a9906d [Feature] block sparse attention (#3668) ...

* 支持稀疏attn

* fix bug

* code style

* fix moba attn get kv shape

* 修复a100编译

* codestyle

* code style

* code style

* code style

* fix conflict

* 增加单侧

* code style

* 增加eblite 加载时间

* fix bug

* for ci

* for ci

* for ci

* for ci

* 支持mlp block size 128

* 增加小算子单测

* fix 单测 mlp

* 将环境变量加入到config里面

* fix rollout config

* 修复显存

* add test server

* add test server

* fix mlp  最后一层使用full attn

2025-08-29 19:46:30 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_model_runner.py

enable dcu ci (#3402)

2025-08-29 10:23:08 +08:00

dcu_worker.py

enable dcu ci (#3402)

2025-08-29 10:23:08 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

gcu_model_runner.py

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

gcu_worker.py

[Feature] support seed parameter (#3161)

2025-08-06 15:20:47 +08:00

gpu_model_runner.py

[Model]support qwen2_5_vl (#3557)

2025-08-29 18:28:39 +08:00

gpu_worker.py

Modified to support custom all reduce by default (#3538)

2025-08-22 16:59:05 +08:00

iluvatar_model_runner.py

[Iluvatar GPU] Optimze attention and moe performance (#3234)

2025-08-08 10:51:24 +08:00

iluvatar_worker.py

[Iluvatar GPU] Modify the names of some variables (#3273)

2025-08-13 11:38:02 +08:00

metax_model_runner.py

[V1 Loader]support param create and load for wint2 and xpu backend (#3581)

2025-08-28 09:49:36 +08:00

metax_worker.py

[MetaxGPU] adapt to the latest fastdeploy on metax gpu (#3492)

2025-08-25 17:44:20 +08:00

model_runner_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

output.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

utils.py

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

worker_base.py

Unify server-side and model-side Config (Part1) (#3018)

2025-07-28 10:51:52 +08:00

worker_process.py

[Feature] block sparse attention (#3668)

2025-08-29 19:46:30 +08:00

xpu_model_runner.py

add dtype int32 (#3692)

2025-08-29 14:56:35 +08:00

xpu_worker.py

revert pr (#3481)

2025-08-21 14:19:50 +08:00