chen ce9c0917c5 [Precision] Support lm_head layer running in float32 (#3597) ...

* support lm_head fp32 bf16 fp16

* support lm_head fp32 bf16 fp16

* add doc and check code

* lm_head_fp32 specify lm_head as fp32

* code check

* check doc

2025-08-27 11:34:53 +08:00

..

best_practices

Modified to support custom all reduce by default (#3538)

2025-08-22 16:59:05 +08:00

features

[Feature] block sparse attention (#3209)

2025-08-26 07:16:04 -07:00

get_started

[MetaxGPU] adapt to the latest fastdeploy on metax gpu (#3492)

2025-08-25 17:44:20 +08:00

online_serving

[Feature] bad words support v1 scheduler and specifiy token ids (#3608)

2025-08-25 20:14:51 -07:00

quantization

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

usage

[Docs]Modify the gpu-memory-utilization of the 128K 8-card Wint4 model to 0.95 (#3428)

2025-08-15 18:34:37 +08:00

zh

[Precision] Support lm_head layer running in float32 (#3597)

2025-08-27 11:34:53 +08:00

benchmark.md

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

index.md

Update README (#3426)

2025-08-15 18:46:28 +08:00

offline_inference.md

rename ernie_xxx to ernie4_5_xxx (#3621)

2025-08-26 19:29:27 +08:00

parameters.md

[Precision] Support lm_head layer running in float32 (#3597)

2025-08-27 11:34:53 +08:00

requirements.txt

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

supported_models.md

[Feature] multi source download (#3005)

2025-07-24 17:42:09 +08:00