mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-12-24 13:28:13 +08:00
polish code with new pre-commit rule (#2923)
This commit is contained in:
@@ -23,6 +23,7 @@
|
||||
|
||||
### 前置依赖 Redis
|
||||
- 使用`conda`安装
|
||||
|
||||
```bash
|
||||
# 安装
|
||||
conda install redis
|
||||
@@ -31,6 +32,7 @@ nohup redis-server > redis.log 2>&1 &
|
||||
```
|
||||
|
||||
- 使用`apt`安装
|
||||
|
||||
```bash
|
||||
# 安装
|
||||
sudo apt install redis-server -y
|
||||
@@ -39,6 +41,7 @@ sudo systemctl start redis-server
|
||||
```
|
||||
|
||||
- 使用`yum`安装
|
||||
|
||||
```bash
|
||||
# 安装
|
||||
sudo yum install redis -y
|
||||
@@ -47,6 +50,7 @@ sudo systemctl start redis
|
||||
```
|
||||
|
||||
### 启动FastDeploy
|
||||
|
||||
```bash
|
||||
python -m fastdeploy.entrypoints.openai.api_server \
|
||||
--port 8801 \
|
||||
@@ -62,6 +66,7 @@ python -m fastdeploy.entrypoints.openai.api_server \
|
||||
--scheduler-min-load_score 3 \
|
||||
--scheduler-load-shards-num 1
|
||||
```
|
||||
|
||||
[启动参数说明](../online_serving/scheduler.md)
|
||||
|
||||
可以将上述启动命令在多个机器执行,启动多个推理实例(如果是在一个机器中启动多个推理实例,注意端口不要冲突)。
|
||||
|
||||
Reference in New Issue
Block a user