apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-04 16:22:57 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

[BugFix] fix ce bugs (#3641)

Browse Source 
* [BugFix] fix tp8 client refuse

* fix engine port bug

* Update utils.py
This commit is contained in:
ltd0924
2025-08-27 20:38:15 +08:00
committed by GitHub
parent 836345a4dd
commit 2974016103
2 changed files with 14 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
fastdeploy/entrypoints/engine_client.py
View File

@@ -77,7 +77,7 @@ class EngineClient:
self.max_model_len = max_model_len
max_chips_per_node = 16 if current_platform.is_iluvatar() else 8
if tensor_parallel_size < max_chips_per_node:
if tensor_parallel_size <= max_chips_per_node:
self.is_master = True
else:
self.is_master = False