Haonan Luo 1b9f351d21 Support GPT-OSS-BF16 (#4240) ...

* [Feature] AppendAtten support sinks & HEAD_DIM=64

* fix bug

* fix bug

* fix bug

* fix bug

* [Feature] support gpt-oss

* fix bug

* add mask

* support-gpt-oss

* support-gpt-oss

* fix long seq

* support wint8

* support wint8

* support wint8

* update test

* change sliding windows init pos

---------

Co-authored-by: ming1753 <ideaminghp@163.com>
Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
Co-authored-by: ming1753 <61511741+ming1753@users.noreply.github.com>

2025-10-20 14:44:58 +08:00

..

ernie4_5_vl

[Iluvatar GPU] Adapt VL model (#4313)

2025-10-17 16:13:38 +08:00

qwen2_5_vl

fix seqlen sync (#4442)

2025-10-17 14:37:52 +08:00

__init__.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

adapters.py

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

deepseek_v3.py

[BugFix]Dev fix custom ar unstable result (#4437)

2025-10-17 11:47:16 +08:00

ernie4_5_moe.py

register_model_class compatible with plugins (#4236)

2025-09-24 11:17:12 +08:00

ernie4_5_mtp.py

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00

glm4_moe.py

[BugFix]Dev fix custom ar unstable result (#4437)

2025-10-17 11:47:16 +08:00

gpt_oss.py

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

interfaces_base.py

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

model_base.py

register_model_class compatible with plugins (#4236)

2025-09-24 11:17:12 +08:00

qwen2.py

register_model_class compatible with plugins (#4236)

2025-09-24 11:17:12 +08:00

qwen3.py

[Feature] support pooling model dummy_run (#4345)

2025-10-17 13:30:55 +08:00

qwen3moe.py

register_model_class compatible with plugins (#4236)

2025-09-24 11:17:12 +08:00

tp_utils.py

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

utils.py

[V1 Loader] support weight_only (#3413)

2025-08-23 13:13:41 +08:00