chen d233e3c97c [Precision] Change lm_head layer running in float32 (#3596) ...

* support lm_head fp32 bf16 fp16

* delete print

* code check

* check

* check

* code check

* check

* check

2025-08-26 20:20:06 +08:00

..

attention

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

backends

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

moe

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

quantization

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

sample

[Feature] Add temp_scaled_logprobs and top_p_normalized_logprobs parameters for logits and logprobs post processing (#3536)

2025-08-25 14:11:18 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

native top_p_sampling (#2901)

2025-07-22 14:09:59 +08:00

embeddings.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

linear.py

[Code Simplification] fix init_distributed_environment() (#2982)

2025-07-24 11:43:28 +08:00

lm_head.py

[Precision] Change lm_head layer running in float32 (#3596)

2025-08-26 20:20:06 +08:00

mtp_linear.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

normalization.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

rotary_embedding.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

[Precision] Change lm_head layer running in float32 (#3596)

2025-08-26 20:20:06 +08:00