apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-09-26 20:41:53 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
Files
release/2.0.0
FastDeploy/fastdeploy
History
AIbin a197dcd729 【Inference Optimize】Support ERNIE-4_5-300B-A47B-2BITS-Paddle model TP2/TP4 Inference (#2666) 
* Support TP2&TP4 Wint

* Support TP2&TP4 Wint2 Inference
2025-07-01 18:29:11 +08:00
..
cache_manager
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
demo
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
distributed
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
engine
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
entrypoints
[Serving] fix offline inference sampling parameters overwrite (#2654)
2025-07-01 10:17:46 +08:00
input
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
inter_communicator
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
metrics
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
model_executor
【Inference Optimize】Support ERNIE-4_5-300B-A47B-2BITS-Paddle model TP2/TP4 Inference (#2666)
2025-07-01 18:29:11 +08:00
output
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
platforms
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
reasoning
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
scheduler
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
spec_decode
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
splitwise
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
worker
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
__init__.py
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
config.py
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
download_model.py
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
envs.py
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
import_ops.py
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
start_splitwise.sh
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
stop.sh
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
test.yaml
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
utils.py
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00