apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 16:48:03 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

merge 2.0.2 into 2.0.3 (#2917)

Browse Source 
Co-authored-by: shige <shige@baidu.com>
This commit is contained in:
sg263
2025-07-22 14:46:20 +08:00
committed by GitHub
parent 4dbc483713
commit 580460046f
5 changed files with 107 additions and 34 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
fastdeploy/engine/engine.py
View File

@@ -58,7 +58,6 @@ class LLMEngine(object):
Attributes:
cfg (Config): Configuration object containing all the parameters.
cached_generated_tokens (queue.Queue): Queue to store generated tokens.
cached_generated_tokens (queue.Queue): Queue to store generated tokens.
scheduler (LocalScheduler or GlobalScheduler): Scheduling tasks.
input_processor (InputPreprocessor): Preprocessor for input data.
resource_manager (ResourceManager): Manager for resource allocation.