apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-08 10:00:29 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[Feature 2.0.2] support top_k_top_p sampling (#2789)

Browse Source 
* support top_k_top_p sampling

* fix

* add api param

* add api para

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* change func name
This commit is contained in:
Sunny-bot1
2025-07-10 12:01:51 +08:00
committed by GitHub
parent 1fe37cb7e8
commit 1107e08cd9
18 changed files with 524 additions and 134 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
fastdeploy/worker/vl_model_runner_base.py
View File

@@ -14,14 +14,14 @@
# limitations under the License.
"""
from abc import ABC, abstractmethod
import argparse
from abc import ABC, abstractmethod
import paddle
import paddle.distributed as dist
import paddle.distributed.fleet as fleet
from fastdeploy.config import ModelConfig
from fastdeploy.config import ModelConfig
from fastdeploy.utils import get_logger
logger = get_logger("worker", "worker.log")