Ayakouji 453487d5b0 [Feat] ernie4_5_vl_moe support CudaGraph (#3226) ...

* delete dynamic control flow for decode

* coda-style

* fix scatter/gather typos and use input stream instead default stream

* support 0-Size Tensor

* update runner and model

* using static mem address as input

* fix mem leak

* refine code

* update mm_buffer

* fix typo

* fix buffersize

* fix unk token

* refine code

* refine

* support other arch

* open cudagraph in vlci

* fix

* update

* update

* update

* fix cmd

* update

---------

Co-authored-by: aquagull <hongyuh@qq.com>
Co-authored-by: Yuanle Liu <yuanlehome@163.com>

2025-09-10 13:11:57 +08:00

..

cache_manager

[metrics] Add serveral observability metrics (#3868)

2025-09-08 14:13:13 +08:00

demo

[Feature] Add AsyncTokenizerClient&ChatResponseProcessor with remote encode&decode support. (#3674)

2025-08-30 17:06:26 +08:00

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

Revert "【FIX】Change the name of sparse attn from moba to plas (#3845)" (#4001)

2025-09-09 11:08:23 +08:00

entrypoints

[Optimize]Error messages about Model api. (#3839)

2025-09-08 15:52:26 +08:00

input

Update qwen_vl_processor.py (#3808)

2025-09-04 20:31:48 +08:00

inter_communicator

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

metrics shared folder naming (#4007)

2025-09-10 10:47:20 +08:00

model_executor

[Feat] ernie4_5_vl_moe support CudaGraph (#3226)

2025-09-10 13:11:57 +08:00

multimodal

[Model]support qwen2_5_vl (#3557)

2025-08-29 18:28:39 +08:00

output

[metrics] Add serveral observability metrics (#3868)

2025-09-08 14:13:13 +08:00

platforms

Revert "【FIX】Change the name of sparse attn from moba to plas (#3845)" (#4001)

2025-09-09 11:08:23 +08:00

plugins

add reasoning parser plugin (#3811)

2025-09-03 18:31:27 +08:00

reasoning

[Feature] add tool parser (#3483)

2025-08-21 17:25:44 +08:00

rl

Revert "【FIX】Change the name of sparse attn from moba to plas (#3845)" (#4001)

2025-09-09 11:08:23 +08:00

scheduler

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

spec_decode

[BugFix] Fix the abnormal memory usage caused by shape errors in the triton moe backend (#4026)

2025-09-09 20:05:54 -07:00

splitwise

[feat] add metrics for yiyan adapter (#3219) (#3614)

2025-08-30 23:20:58 +08:00

worker

[BugFix] Fix the abnormal memory usage caused by shape errors in the triton moe backend (#4026)

2025-09-09 20:05:54 -07:00

__init__.py

[BugFix] Fix default log level of paddleformers (#3376)

2025-08-14 11:36:24 +08:00

config.py

get org_vocab_size from args (#3983)

2025-09-09 15:08:03 +08:00

envs.py

cache feature (#3857)

2025-09-07 18:52:46 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[BugFix] Fix the abnormal memory usage caused by shape errors in the triton moe backend (#4026)

2025-09-09 20:05:54 -07:00