qwes5s5
|
117980dd4e
|
[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)
* add prompt logprobs
* Merge prompt_logprobs_tensors and prompt_logprobs
* fix param check
* trigger ci
* fix unitest
* fix logprobs bug
|
2025-12-02 13:49:51 +08:00 |
|
qwes5s5
|
a2d06118e1
|
[Logprobs]Support prompt_logprobs and max_logprobs (#4897)
* add prompt logprobs
* trigger ci
* fix unitest
* Update fastdeploy/config.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update fastdeploy/entrypoints/llm.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update fastdeploy/engine/sampling_params.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update tests/engine/test_sampling_params.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* Update tests/engine/test_sampling_params.py
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
* fix max_logprobs
---------
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
2025-11-12 19:29:48 +08:00 |
|
Echo-Nie
|
ff653503ff
|
[Docs] Add License in Unittest (#4957)
* add copyright
* add CopyRight
|
2025-11-12 10:44:09 +08:00 |
|
Echo-Nie
|
112623e33e
|
init version, exist some bugs, waiting fix (#4906)
CE Compile Job / ce_job_pre_check (push) Has been cancelled
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
CE Compile Job / Show Code Archive Output (push) Has been cancelled
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Deploy GitHub Pages / deploy (push) Has been cancelled
|
2025-11-10 14:16:09 +08:00 |
|
zhouchong
|
35286ce31a
|
fix total_block_num init error in worker_process (#4687)
|
2025-10-30 19:53:09 +08:00 |
|
zhouchong
|
567f61072c
|
[CI][BugFix] fix port conflicts in concurrent ci test and add more unit test on async_llm (#4616)
* fix:port conflicts in concurrent ci test
* add more unit test on async_llm
|
2025-10-28 19:04:24 +08:00 |
|
zhouchong
|
dce988824d
|
[Feature] Support AsyncLLM (#4458)
CE Compile Job / ce_job_pre_check (push) Has been cancelled
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
CE Compile Job / Show Code Archive Output (push) Has been cancelled
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Deploy GitHub Pages / deploy (push) Has been cancelled
* add async_llm
* apply review
* update engine config
* Adapt to latest engine.py changes
* add more unit tests
* Increase unit test coverage
---------
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
|
2025-10-22 15:50:12 +08:00 |
|