yangjianfengo1 ae7bee8122 【New Feature】W4afp8 supports per group quantization (#4987) ...

* w4afp8 支持per group

* code style

* fix transpose

* revert fast hardmard

---------

Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com>
Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>

2025-11-13 19:17:27 +08:00

..

benchmarks

[CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558)

2025-10-24 16:46:45 +08:00

cache_manager

[KVCache] support unified cache backend (#4903)

2025-11-12 14:54:52 +08:00

ce

Update deploy.py (#4850)

2025-11-06 19:09:28 +08:00

ci_use

[XPU] [CI] Change CI ep test from offline to online (#4885)

2025-11-13 16:15:45 +08:00

distributed

[CI] Add five unittest (#4958)

2025-11-12 10:43:33 +08:00

e2e

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

engine

[Logprobs]Support prompt_logprobs and max_logprobs (#4897)

2025-11-12 19:29:48 +08:00

entrypoints

[Logprobs]Support prompt_logprobs and max_logprobs (#4897)

2025-11-12 19:29:48 +08:00

graph_optimization

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

input

Update Unit Test for PaddleOCR-VL (#4802)

2025-11-04 22:40:15 +08:00

inter_communicator

perf: Optimize task queue communication from engine to worker (#4531)

2025-10-25 22:45:38 +08:00

layers

[CI] set DG_NVCC_OVERRIDE_CPP_STANDARD in test_quantized_linear (#4995)

2025-11-12 23:03:21 +08:00

logger

[CI] Add five unittest (#4958)

2025-11-12 10:43:33 +08:00

metrics

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

model_executor

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

model_loader

[CI] fix test_model_cache (#4982)

2025-11-12 20:26:49 +08:00

multimodal

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

operators

【New Feature】W4afp8 supports per group quantization (#4987)

2025-11-13 19:17:27 +08:00

output

[Logprobs]Support prompt_logprobs and max_logprobs (#4897)

2025-11-12 19:29:48 +08:00

platforms

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

plugins

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

pooling

[Feature] support pooling model runner (#4590)

2025-10-31 22:32:05 +08:00

quantization

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

reasoning

[BugFix] Fix ernie_vl_reasoning_parsers.py 'end_token' to 'think_end_token' (#4805)

2025-11-06 11:28:55 +08:00

utils

[Docs] Add License in Unittest (#4957)

2025-11-12 10:44:09 +08:00

v1

[FDConfig] add block number verfied (#4983)

2025-11-13 09:48:44 +08:00

woker

[Others] Add Tests for GPU Model Runner and Logprobs Output (#4913)

2025-11-11 18:37:33 +08:00

conftest.py

[CI] fix test_model_cache (#4982)

2025-11-12 20:26:49 +08:00

cov_pytest.ini

[CI] Handle unit test issues (#4483)

2025-10-20 10:13:21 +08:00

utils.py

[Benchmark] Add GEMM & MoE kernel bench (#4809)

2025-11-12 11:56:40 +08:00