AIbin a197dcd729 【Inference Optimize】Support ERNIE-4_5-300B-A47B-2BITS-Paddle model TP2/TP4 Inference (#2666) ...

* Support TP2&TP4 Wint

* Support TP2&TP4 Wint2 Inference

2025-07-01 18:29:11 +08:00

..

attention

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

backends

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

moe

【Inference Optimize】Support ERNIE-4_5-300B-A47B-2BITS-Paddle model TP2/TP4 Inference (#2666)

2025-07-01 18:29:11 +08:00

quantization

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

sample

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

embeddings.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

hydra_head.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

linear.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

lm_head.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

normalization.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

rotary_embedding.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

utils.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00