Ryan
f72c4de539
[SOT] Make custom_op dy&st unified ( #2733 )
...
Deploy GitHub Pages / deploy (push) Has been cancelled
* make_custom_op dy&st unified
* add instance judgement
2025-07-08 19:21:44 +08:00
RichardWooSJTU
e8bbe7244b
[Bug fix] fix attention rank init ( #2743 )
...
* fix attention rank init
* fix attention rank init
2025-07-08 17:19:49 +08:00
Longzhi Wang
57b086dc6b
[Bug fix] Add the missing pod_ip param to the launch_cache_manager function. ( #2742 )
...
Deploy GitHub Pages / deploy (push) Has been cancelled
* [Bug fix] fix the missing position args in expert_service.py
* update
2025-07-08 14:52:13 +08:00
lizexu123
525be243e7
[Bug fix] Fixed the garbled text issues in Qwen3-8B ( #2737 )
...
* fix qwen3.py
* update
* update lm_head tie_word_embeddings
* update tie_word_embeddings
* fix
* fix tie_word_embedding not in config.json
---------
Co-authored-by: lizexu <lizexu@baidu.com >
2025-07-07 23:15:27 -07:00
EnflameGCU
d0f4d6ba3a
[GCU] Support gcu platform ( #2702 )
...
baseline: e7fa57ebaexing.wo@163.com >
2025-07-08 13:00:52 +08:00
gaoziyuan
26d5d737dd
【Fearture】support qwen2 some func ( #2740 )
...
* add rl qwen model support
* fix
* fix
2025-07-08 12:03:04 +08:00
Ryan
fefbd65cf8
[SOT] Remove BreakGraph with paddle.maximum ( #2731 )
...
* rm if with clip
* clip -> maximum
* int64 -> int32
2025-07-08 11:44:25 +08:00
ming1753
1eb8ea7328
[Bug fix] fix complie bug when sm < 89 ( #2738 )
2025-07-08 11:24:52 +08:00
ming1753
ef6649a577
[Optimize] Optimize tensorwise fp8 performance ( #2729 )
...
Deploy GitHub Pages / deploy (push) Has been cancelled
* [Optimize] Optimize tensorwise fp8 performance
2025-07-07 20:06:28 +08:00
liddk1121
1b54a2831e
Adapt for iluvatar gpu ( #2684 )
2025-07-07 16:53:14 +08:00
lddfym
4e293e50fa
Check if the controller port is available ( #2724 )
2025-07-07 13:24:55 +08:00
ltd0924
68b4755587
[LLM] support multi node deploy ( #2708 )
...
Deploy GitHub Pages / deploy (push) Has been cancelled
* [LLM] support multi node deploy
* Update engine.py
* fix bugs
* fix
* [LLM] support multi node deploy
* [LLM] support multi node deploy
---------
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com >
2025-07-06 10:33:51 +08:00
Ting
a6e9161045
fix bug. ( #2718 )
Deploy GitHub Pages / deploy (push) Has been cancelled
2025-07-05 08:19:19 +08:00
Ting
90ef28d982
spec token map lazy. ( #2715 )
Deploy GitHub Pages / deploy (push) Has been cancelled
2025-07-05 00:14:54 +08:00
lizexu123
9cb08e71e8
add support QWQ enable_thinking ( #2706 )
...
* add support QWQ enable_thinking
* add stream=True
* fix stream=true
* fix qwen
---------
Co-authored-by: lizexu <lizexu@baidu.com >
2025-07-04 20:55:23 +08:00
GoldPancake
e7fa57ebae
Extract eh_proj Layer from ParallelLMHead for MTP to Avoid Weight Transposition Issue ( #2707 )
...
Deploy GitHub Pages / deploy (push) Has been cancelled
* fix mtp eh_proj layer
* fix mtp update_cfg function
* fix stringdoc
* simplify class name
2025-07-04 14:15:04 +08:00
gaoziyuan
a5ae88ded9
[feature]add fd whl version info ( #2698 )
2025-07-04 14:12:42 +08:00
ltd0924
87e638498c
[RL] update reschedule finish reason ( #2709 )
2025-07-04 13:47:36 +08:00
freeliuzc
667547be59
support chunk_prefill in MTP ( #2705 )
2025-07-04 11:55:48 +08:00
Yuanle Liu
240bdac2a4
[feat] support fa3 backend for pd disaggregated ( #2695 )
...
Deploy GitHub Pages / deploy (push) Has been cancelled
* support fa3 backend run in pd disaggregated
* support fa3 backend run in pd disaggregated
* support fa3 backend run in pd disaggregated
* support fa3 backend run in pd disaggregated
* delete use_fast_ffn
2025-07-03 22:33:27 +08:00
ltd0924
00863c43fd
[Bug] fix logger format ( #2689 )
Deploy GitHub Pages / deploy (push) Has been cancelled
2025-07-03 19:58:03 +08:00
Jiang-Jia-Jun
9fd74f75bd
Update dynamic_weight_manager.py
2025-07-03 15:55:22 +08:00
Jiang-Jia-Jun
05c670e593
[Sync] Update to latest code ( #2679 )
...
* [Sync] Update to latest code
* Add new code files
* Add new code files
* update code
* Try to fix build.sh
* Try to fix build.sh
* Update code
* Update requirements.txt
* Update code
---------
Co-authored-by: Jiang-Jia-Jun <jiangjiajun@baidu.com >
2025-07-03 15:43:53 +08:00
AIbin
a197dcd729
【Inference Optimize】Support ERNIE-4_5-300B-A47B-2BITS-Paddle model TP2/TP4 Inference ( #2666 )
...
* Support TP2&TP4 Wint
* Support TP2&TP4 Wint2 Inference
2025-07-01 18:29:11 +08:00
ltd0924
50aa4080c0
[Serving] fix offline inference sampling parameters overwrite ( #2654 )
2025-07-01 10:17:46 +08:00
Jiang-Jia-Jun
92c2cfa2e7
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
jiangjiajun
fb18f3092d
[LLM] Add output module and polish docs
2025-06-09 20:26:53 +08:00
jiangjiajun
684703fd72
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
Zheng-Bicheng
9faf1b5ad9
Merge branch 'PaddlePaddle:develop' into develop
2025-02-12 21:23:36 +08:00
Jiang-Jia-Jun
d4bbdbefea
Merge pull request #2559 from MaaXYZ/fix/build_error
...
fix: build error without ENABLE_PADDLE2ONNX
2025-01-10 13:55:49 +08:00
Jiang-Jia-Jun
618826b39d
Merge pull request #2560 from MaaXYZ/perf/read_file
...
perf: ReadBinaryFromFile supports Chinese path
2025-01-10 13:55:27 +08:00
Jiang-Jia-Jun
17d204b975
Merge pull request #2561 from MaaXYZ/feat/directml
...
feat: select adapter id for DirectML
2025-01-10 13:54:44 +08:00
MistEO
ec3d4c714c
fix: valid_directml_backends
2024-11-21 16:47:16 +08:00
MistEO
11214a642f
fix: typo of log
2024-11-21 16:11:31 +08:00
MistEO
227cc37a7b
fix: config including
2024-11-21 16:02:19 +08:00
MistEO
2507a172f8
feat: select adapter id for DirectML
2024-11-20 14:38:32 +08:00
MistEO
e321ae55a1
fix: windows build error
2024-11-20 00:27:27 +08:00
MistEO
5662fa3903
fix: build error for CI
2024-11-19 19:16:16 +08:00
MistEO
1bbba6fbe3
fix: build error on old C++ std
2024-11-19 19:12:17 +08:00
MistEO
f5ccf62fda
perf: ReadBinaryFromFile supports Chinese path
2024-11-19 19:04:19 +08:00
MistEO
eca2ae8b94
fix: build error without ENABLE_PADDLE2ONNX
2024-11-19 16:37:46 +08:00
Zheng-Bicheng
527536565a
Update cosine_similarity.cc
2024-11-07 16:41:03 +08:00
ChaoII
0ae0dc9d82
[BUG FIX] fix memory leak for ort backend
2024-03-29 09:00:05 +08:00
ChaoII
cc8d1f3c9f
[BUG FIX] add export declaration of GaussianRandom function ( #2379 )
...
* Update fd_type.cc
[bug fix]add define for destroy TwoDimArrayCstr for c_api
* [BUG FIX] add export declaration of GaussianRandom function
2024-03-05 13:37:20 +08:00
Albin
1314f3267e
bug fix: 修复contrib中的det模型后处理在遇到没有检测框的图时导致同batch中接下来的图片结果全部为空的bug ( #2378 )
2024-02-27 19:21:17 +08:00
ThinkWD
cfd80e95a1
修复 #2359 ( #2363 )
...
Update pptinypose_utils.cc
添加 py 范围限制, 避免 utils::DarkParse 内部出现数组越界
2024-01-29 19:16:19 +08:00
DefTruth
cfebd24dfc
[Backend] fix ort backend windows build error ( #2269 )
...
* support ort offline graph optimize option
* support ort offline graph optimize option
* [Backend] fix windows build error
2023-11-02 12:51:46 +08:00
DefTruth
6a8cd4d759
[Backend] support ort offline graph optimize option ( #2268 )
...
* support ort offline graph optimize option
* support ort offline graph optimize option
2023-11-02 09:19:33 +08:00
Jason
d910d6116c
[Model] Fix nms problem ( #2230 )
...
fix nms problem
2023-10-10 16:24:33 +08:00
ChaoII
771dcf4b91
[Backend]Update sophgo_backend.cc for FP16 data type ( #2161 )
2023-08-16 14:12:58 +08:00
