Sunny-bot1
|
4596dd7248
|
[FIX 2.0.2]fix topp topk default value (#2810)
* fix topp topk default value
* update topk
|
2025-07-11 16:12:02 +08:00 |
|
chen
|
823a47e64a
|
[Feature] Support return logprob of generated tokens (#2784)
* online chat support logprobs
* check xpu
* check vl_gpu_model_runner
* only cuda support logprob
* get_worker() check platform
---------
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
|
2025-07-10 15:47:42 +08:00 |
|
Sunny-bot1
|
1107e08cd9
|
[Feature 2.0.2] support top_k_top_p sampling (#2789)
* support top_k_top_p sampling
* fix
* add api param
* add api para
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* change func name
|
2025-07-09 21:01:51 -07:00 |
|
Jiang-Jia-Jun
|
92c2cfa2e7
|
Sync v2.0 version of code to github repo
|
2025-06-29 23:29:37 +00:00 |
|
jiangjiajun
|
684703fd72
|
[LLM] First commit the llm deployment code
|
2025-06-09 19:20:15 +08:00 |
|