Echo-Nie
|
1b1bfab341
|
[CI] Add unittest (#5328)
* add test_worker_eplb
* remove tesnsor_wise_fp8
* add copyright
|
2025-12-09 19:19:42 +08:00 |
|
qwes5s5
|
a52aea073c
|
fix logprobs (#5335)
|
2025-12-04 10:38:51 +08:00 |
|
qwes5s5
|
117980dd4e
|
[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)
* add prompt logprobs
* Merge prompt_logprobs_tensors and prompt_logprobs
* fix param check
* trigger ci
* fix unitest
* fix logprobs bug
|
2025-12-02 13:49:51 +08:00 |
|
qwes5s5
|
a2d06118e1
|
[Logprobs]Support prompt_logprobs and max_logprobs (#4897)
* add prompt logprobs
* trigger ci
* fix unitest
* Update fastdeploy/config.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update fastdeploy/entrypoints/llm.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update fastdeploy/engine/sampling_params.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update tests/engine/test_sampling_params.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update tests/engine/test_sampling_params.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix max_logprobs
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2025-11-12 19:29:48 +08:00 |
|