apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-10 02:50:19 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity

[Bugs] Fix DeepGEMM pre-compile tools. (#3351)

Browse Source 
Fix some miss cache problems.
Add README.md.
This commit is contained in:
GoldPancake
2025-08-15 14:37:49 +08:00
committed by GitHub
parent d4e3a20300
commit 4bd6a9fa7d
4 changed files with 198 additions and 52 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
tools/deep_gemm_pre-compile/pre_compile.py
View File

@@ -162,25 +162,25 @@ def pre_compile_from_config(config_file: str, num_threads: int, expert_parallel:
def main(args):
pre_compile_from_config(args.config_file, args.num_threads, args.expert_parallel)
pre_compile_from_config(args.config_file, args.num_threads, args.expert_parallel_size)
if __name__ == "__main__":
parser = argparse.ArgumentParser()
parser.add_argument(
"--config_file",
"--config-file",
type=str,
default="./deep_gemm_pre_compile_config.jsonl",
)
parser.add_argument(
"--expert_parallel",
"--expert-parallel-size",
"--ep",
type=int,
default=8,
)
parser.add_argument(
"--num_threads",
"--num-threads",
type=int,
default=16,
)