mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-12-24 13:28:13 +08:00
8aab4e367f
* support mm prefix caching * update code * fix mm_hashes * support encoder cache * add encoder cache * update code * update encoder cache * fix features bug * fix worker bug * support processor cache, need to optimize yet * refactor multimodal data cache * update code * update code * update v1 scheduler * update code * update code * update codestyle * support turn off processor cache and encoder cache * update pre-commit * fix code * solve review * update code * update code * update test case * set processor cache in GiB * update test case * support mm prefix caching for qwen model * fix code style check * update pre-commit * fix unit test * fix unit test * add ci test case * fix rescheduled bug * change text_after_process to prompt_tokens * fix unit test * fix chat template * change model path * [EP] fix adapter bugs (#4572) * Update expert_service.py * Update common_engine.py * Update expert_service.py * fix v1 hang bug (#4573) * fix import image_ops error on some platforms (#4559) * [CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558) * add collect-env * del files * [Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578) * add new branch for sot * reorder * fix batch bug * [XPU]Moe uses a new operator (#4585) * [XPU]Moe uses a new operator * [XPU]Moe uses a new operator * update response * [Feature] Support Paddle-OCR (#4396) * init * update code * fix code style & disable thinking * adapt for common_engine.update_mm_requests_chunk_size * use 3d rope * use flash_attn_unpadded * opt siglip * update to be compatible with the latest codebase * fix typo * optim OCR performance * fix bug * fix bug * fix bug * fix bug * normlize name * modify xpu rope * revert logger * fix bug * fix bug * fix bug * support default_v1 * optim performance * fix bug --------- Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com> * [DataProcessor] add reasoning_tokens into usage info (#4520) * add reasoning_tokens into usage info initial commit * add unit tests * modify unit test * modify and add unit tests * fix unit test * move steam usage to processor * modify processor * modify test_logprobs * modify test_logprobs.py * modify stream reasoning tokens accumulation * fix unit test * perf: Optimize task queue communication from engine to worker (#4531) * perf: Optimize task queue communication from engine to worker * perf: get_tasks to numpy * perf: get_tasks remove to_numpy * fix: request & replace ENV * remove test_e2w_perf.py * fix code style --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> * Clean up ports after processing results (#4587) * [CI] Add /re-run command in PR comments to restart failed CI workflows (#4593) * [Others] api server exits when worker process is dead (#3271) * [fix] fix terminal hangs when worker process is dead * [chore] change sleep time of monitor * [chore] remove redundant comments * update docs --------- Co-authored-by: ApplEOFDiscord <wwy640130@163.com> Co-authored-by: ApplEOFDiscord <31272106+ApplEOFDiscord@users.noreply.github.com> Co-authored-by: ltd0924 <32387785+ltd0924@users.noreply.github.com> Co-authored-by: yinwei <yinwei_hust@163.com> Co-authored-by: JYChen <zoooo0820@qq.com> Co-authored-by: qwes5s5 <45442318+qwes5s5@users.noreply.github.com> Co-authored-by: Ryan <zihaohuang@aliyun.com> Co-authored-by: yyssys <atyangshuang@foxmail.com> Co-authored-by: ming1753 <61511741+ming1753@users.noreply.github.com> Co-authored-by: root <root@szzj-acg-tge1-fdda9.szzj.baidu.com> Co-authored-by: zhangyue66 <zhangyue66@baidu.com> Co-authored-by: kxz2002 <115912648+kxz2002@users.noreply.github.com> Co-authored-by: SunLei <sunlei5788@gmail.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> Co-authored-by: Zhang Yulong <35552275+ZhangYulongg@users.noreply.github.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com> Co-authored-by: 李泳桦 <39643373+liyonghua0910@users.noreply.github.com>
45 lines
2.1 KiB
Markdown
45 lines
2.1 KiB
Markdown
[English](../../usage/log.md)
|
|
|
|
# 日志说明
|
|
|
|
FastDeploy 在部署过程中，会产生如下日志文件，各日志含义说明
|
|
默认日志目录为执行目录下的 `log` 文件夹，若需要指定可设置环境变量 `FD_LOG_DIR`。
|
|
|
|
## 推理服务日志
|
|
* `backup_env.*.json` : 记录当前实例启动时设置的环境变量，文件个数与卡数相同
|
|
* `envlog.*` : 记录当前实例启动时设置的环境变量，文件个数与卡数相同
|
|
* `console.log` : 记录模型启动耗时等信息，该日志信息会被打印到控制台
|
|
* `data_processor.log` : 记录输入数据及输出输出编码解码的内容
|
|
* `fastdeploy.log` : 记录当前实例启动的各个 config 的信息，运行中记录用户请求的 request 及 response 信息
|
|
* `workerlog.*` : 记录模型启动加载进度及推理算子报错信息，每个卡对应一个文件
|
|
* `worker_process.log` : 记录引擎每一轮推理的数据
|
|
* `cache_manager.log` : 记录每一个请求分配 KV Cache 的逻辑索引，以及当前请求的命中情况
|
|
* `launch_worker.log` : 记录模型启动信息及报错信息
|
|
* `gpu_worker.log` : 记录 profile 时计算 KV Cache block 数目的信息
|
|
* `gpu_model_runner.log` : 当前的模型信息及加载时间
|
|
|
|
## 在线推理客户端日志
|
|
* `api_server.log` : 记录启动参数，及接收到的请求信息
|
|
|
|
## 调度器日志
|
|
* `scheduler.log` : 记录调度器的信息包含当前结点的信息，每条请求分配的信息
|
|
|
|
## 投机解码日志
|
|
* `speculate.log` : 投机解码相关信息
|
|
|
|
## Prefix Caching 相关日志
|
|
|
|
* `cache_queue_manager.log` : 记录启动参数，及接收到的请求信息
|
|
* `cache_transfer_manager.log` : 记录启动参数，及接收到的请求信息
|
|
* `cache_queue_manager.log` : 记录启动参数，及接收到的请求信息
|
|
* `launch_cache_manager.log` : 启动 cache transfer 记录启动参数，报错信息
|
|
|
|
## PD 分离相关日志
|
|
|
|
* `cache_messager.log` : 记录P 实例使用的传输协议及传输信息
|
|
* `splitwise_connector.log` : 记录收到 P/D 发送的数据，及建联信息
|
|
|
|
## CudaGraph 相关日志
|
|
|
|
* `cudagraph_piecewise_backend.log` : 记录 cuda graph 启动及报错信息
|