zhenwenDang d48c03413f Feature/logprob bug fix (#2817) ...

* fix: handle missing logprobs at step 0 and incorrect finish reason with max_completion_tokens

* Prevent response_logprobs.logprob_token_ids[0] from going out of bounds

2025-07-12 16:48:51 +08:00

..

cache_manager

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

demo

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

distributed

[Feature] support custom all-reduce (#2758)

2025-07-09 16:00:27 +08:00

engine

fix topp default value (#2814)

2025-07-11 17:10:21 +08:00

entrypoints

Feature/logprob bug fix (#2817)

2025-07-12 16:48:51 +08:00

input

[Doc] modify offline-inerence docs (#2800)

2025-07-10 19:41:12 +08:00

inter_communicator

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

metrics

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

model_executor

support qwen3moe name_mapping (#2820)

2025-07-12 12:05:54 +08:00

output

[Feature] Online Chat API Support Return logprobs (#2777)

2025-07-10 16:33:40 +08:00

platforms

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

reasoning

add support QWQ enable_thinking (#2706)

2025-07-04 20:55:23 +08:00

rl

support qwen3moe name_mapping (#2820)

2025-07-12 12:05:54 +08:00

scheduler

Global scheduler supports configuring hot updates (#2807)

2025-07-11 13:38:07 +08:00

spec_decode

[Executor] Move forward_meta.py to fastdeploy/model_executor (#2774)

2025-07-10 20:36:51 +08:00

splitwise

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

worker

fix num_blocks_local when small size model in TP2 running mode (#2792)

2025-07-12 12:50:48 +08:00

__init__.py

[feature]add fd whl version info (#2698)

2025-07-04 14:12:42 +08:00

config.py

[BugFix] fix RMSNorm rms_norm_esp (#2797)

2025-07-10 20:02:24 +08:00

envs.py

[Fix]fix top_k_top_p sampling (#2801)

2025-07-10 22:35:10 +08:00

import_ops.py

[SOT] Make custom_op dy&st unified (#2733)

2025-07-08 19:21:44 +08:00

stop.sh

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[feature]add fd whl version info (#2698)

2025-07-04 14:12:42 +08:00