ltd0924
|
d245d1ca6c
|
[LLM] support send batch data and aggregate data (#2860)
* [LLM] support send batch data and aggregate data
* [LLM] fix ci bugs
* [LLM] fix ci bugs
* [LLM] fix ci bugs
* [LLM] fix ci bugs
* [LLM] update
|
2025-07-16 23:42:20 +08:00 |
|
sg263
|
42b80182e0
|
[Trace] add opentelemetry (#2852)
* add opentelemetry
* add opentelemetry
* add opentelemetry on dequeue
* add opentelemetry on dequeue
* add opentelemetry on dequeue
---------
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
|
2025-07-16 15:33:25 +08:00 |
|
chen
|
d33105baeb
|
[Feature] Online Chat API Support Return logprobs (#2777)
* online chat support logprobs
* check xpu
* check vl_gpu_model_runner and xpu_model_runner
* get_worker() check platform
|
2025-07-10 16:33:40 +08:00 |
|
Jiang-Jia-Jun
|
92c2cfa2e7
|
Sync v2.0 version of code to github repo
|
2025-06-29 23:29:37 +00:00 |
|
jiangjiajun
|
684703fd72
|
[LLM] First commit the llm deployment code
|
2025-06-09 19:20:15 +08:00 |
|