AIbin beec24fd89 【Inference Optimize】DeepSeek-v3 model inference performance optimization (#3455) ...

* DSK_OPT_01

* update FA3

2025-08-19 10:42:42 +08:00

..

cache_manager

[Bug fix] fix block num setting in scheduler v1 for develop (#3303)

2025-08-12 10:38:51 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

delete parallel_state.py (#3250)

2025-08-08 11:03:29 +08:00

engine

[Feature] add custom chat template (#3251)

2025-08-18 16:34:08 +08:00

entrypoints

【BugFix】completion接口echo回显支持 (#3245)

2025-08-19 10:41:51 +08:00

input

[Feature] add custom chat template (#3251)

2025-08-18 16:34:08 +08:00

inter_communicator

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

metrics

[Trace]add trace when fd start (#3174)

2025-08-05 21:18:27 +08:00

model_executor

【Inference Optimize】DeepSeek-v3 model inference performance optimization (#3455)

2025-08-19 10:42:42 +08:00

multimodal

Remove useless code (#3337)

2025-08-12 10:32:31 +08:00

output

Launch expert_service before kv_cache initialization in worker_process (#3045)

2025-08-11 19:38:46 +08:00

platforms

[MetaxGPU] Support FastDeploy on metax gpu (#3241)

2025-08-13 11:11:54 +08:00

plugins

[plugin] Custom model_runner/model support (#3186)

2025-08-04 18:52:39 -07:00

reasoning

add Tool Parser (#3272)

2025-08-13 01:06:55 +08:00

rl

fix some bug (#3434)

2025-08-18 14:39:13 +08:00

scheduler

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

spec_decode

[Code Simplification] remove cum_offsets (#3410)

2025-08-18 20:21:25 +08:00

splitwise

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

worker

[Code Simplification] remove cum_offsets (#3410)

2025-08-18 20:21:25 +08:00

__init__.py

[BugFix] Fix default log level of paddleformers (#3376)

2025-08-14 11:36:24 +08:00

config.py

[Excutor] Change cudagraph hashkey from batch size to num_tokens (#3454)

2025-08-18 16:16:48 +08:00

envs.py

Update envs.py

2025-08-12 16:24:47 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

add Tool Parser (#3272)

2025-08-13 01:06:55 +08:00