Sunny-bot1 240d6236bc [Fix]fix top_k_top_p sampling (#2801) ...

* fix topk-topp

* update

* add base_non_truncated

2025-07-10 22:35:10 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_worker.py

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

eplb.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

experts_manager.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

gcu_model_runner.py

[Fix]fix top_k_top_p sampling (#2801)

2025-07-10 22:35:10 +08:00

gcu_worker.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

gpu_model_runner.py

[Fix]fix top_k_top_p sampling (#2801)

2025-07-10 22:35:10 +08:00

gpu_worker.py

Clear dead code And supplementary notes (#2757)

2025-07-09 16:17:34 +08:00

iluvatar_model_runner.py

[Fix]fix top_k_top_p sampling (#2801)

2025-07-10 22:35:10 +08:00

iluvatar_worker.py

Adapt for iluvatar gpu (#2684)

2025-07-07 16:53:14 +08:00

model_runner_base.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

output.py

[Feature] Online Chat API Support Return logprobs (#2777)

2025-07-10 16:33:40 +08:00

utils.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

vl_gpu_model_runner.py

[Executor] Move forward_meta.py to fastdeploy/model_executor (#2774)

2025-07-10 20:36:51 +08:00

vl_model_runner_base.py

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

vl_worker_process.py

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

worker_base.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

worker_process.py

[BugFix] fix RMSNorm rms_norm_esp (#2797)

2025-07-10 20:02:24 +08:00

xpu_model_runner.py

[Fix]fix top_k_top_p sampling (#2801)

2025-07-10 22:35:10 +08:00

xpu_worker.py

fix xpu offline demo garbled output (#2763)

2025-07-09 14:51:20 +08:00