Yuanle Liu 56e2d7e668 adaptive rms_norm's dtype (#3617) ...

* adaptive rms_norm's dtype

* adaptive rms_norm's dtype

* add approve coverage

---------

Co-authored-by: liuyuanle <liuyuanle@baidu.com>

2025-08-26 15:29:15 +08:00

..

attention

Add custom op declaration for all_reduce (#3473)

2025-08-20 20:29:58 +08:00

backends

[MetaxGPU] adapt to the latest fastdeploy on metax gpu (#3492)

2025-08-25 17:44:20 +08:00

moe

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

quantization

support w4afp8 EP inference (#3044)

2025-08-25 11:27:45 +08:00

sample

[Feature] Add temp_scaled_logprobs and top_p_normalized_logprobs parameters for logits and logprobs post processing (#3552)

2025-08-25 14:11:49 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Polish Code] Remove useless notes

2025-08-14 14:04:52 +08:00

embeddings.py

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

linear.py

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

lm_head.py

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

adaptive rms_norm's dtype (#3617)

2025-08-26 15:29:15 +08:00

rotary_embedding.py

[MetaxGPU] Support FastDeploy on metax gpu (#3241)

2025-08-13 11:11:54 +08:00

utils.py

[V1 Loader] support weight_only (#3413)

2025-08-23 13:13:41 +08:00