apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-07 09:31:35 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Sync] Update to latest code (#2679)

Browse Source 
* [Sync] Update to latest code

* Add new code files

* Add new code files

* update code

* Try to fix build.sh

* Try to fix build.sh

* Update code

* Update requirements.txt

* Update code

---------

Co-authored-by: Jiang-Jia-Jun <jiangjiajun@baidu.com>
This commit is contained in:
Jiang-Jia-Jun
2025-07-03 15:43:53 +08:00
committed by GitHub
parent d222248d00
commit 05c670e593
95 changed files with 9916 additions and 1312 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
fastdeploy/model_executor/layers/attention/attention_selecter.py
View File

@@ -16,6 +16,7 @@
from functools import cache
from fastdeploy import envs
from fastdeploy.platforms import _Backend, current_platform
from fastdeploy.utils import resolve_obj_from_strname
@@ -40,6 +41,7 @@ def _get_attn_backend(selected_backend: str) -> object:
return resolve_obj_from_strname(attention_cls)
def get_attention_backend(selected_backend):
"""Selects which attention backend ."""
return _get_attn_backend(selected_backend)
def get_attention_backend() -> object:
"""Selects which attention backend."""
attention_backend = envs.FD_ATTENTION_BACKEND
return _get_attn_backend(attention_backend)