freeliuzc c753f1fc9e [Feature][MTP]Support new mtp (#3656) ...

* update multi-draft-token strategy

* fix format

* support hybrid mtp with ngram speculative decoding method

2025-08-27 19:38:26 +08:00

..

draft_model_postprocess.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

draft_model_preprocess.cu

[Feature][MTP]Support new mtp (#3656)

2025-08-27 19:38:26 +08:00

draft_model_set_value_by_flags.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

draft_model_update.cu

[Feature][MTP]Support new mtp (#3656)

2025-08-27 19:38:26 +08:00

eagle_get_base_model_hidden_states.cu

[Feature][MTP]Support new mtp (#3656)

2025-08-27 19:38:26 +08:00

eagle_get_self_hidden_states.cu

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

hydra_fetch_hidden_states.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

mtp_save_first_token.cc

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

mtp_step_paddle.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

ngram_match_mixed.cu

[Feature][MTP]Support new mtp (#3656)

2025-08-27 19:38:26 +08:00