sg263 5a5f17cf97 fix put opentelemetry-instrumentation-fastapi in requierment (#2874) ...

* add opentelemetry

* add opentelemetry

* add opentelemetry on dequeue

* add opentelemetry on dequeue

* add opentelemetry on dequeue

* fix opentelemetry-instrumentation-fastapi

* fix annotation

---------

Co-authored-by: shige <shige@baidu.com>

2025-07-17 00:41:53 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

args_utils.py

[Feature] Support return logprob of generated tokens (#2784)

2025-07-10 15:47:42 +08:00

config.py

[Feature] Support return logprob of generated tokens (#2784)

2025-07-10 15:47:42 +08:00

engine.py

fix put opentelemetry-instrumentation-fastapi in requierment (#2874)

2025-07-17 00:41:53 +08:00

expert_service.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

kv_cache_interface.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

request.py

[Trace] Support trace log (#2864)

2025-07-16 15:35:44 +08:00

resource_manager.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

sampling_params.py

[FIX 2.0.2]fix topp topk default value (#2810)

2025-07-11 16:12:02 +08:00