apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

remove input_ids from ForwardMeta (#4793)
Some checks failed
CE Compile Job / ce_job_pre_check (push) Has been cancelled
Details
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
Details
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
Details
CE Compile Job / Show Code Archive Output (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
Details
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Details
Deploy GitHub Pages / deploy (push) Has been cancelled
Details

Browse Source
This commit is contained in:
周周周
2025-11-05 11:55:51 +08:00
committed by GitHub
parent 9676cc87d6
commit 876e4a8935
13 changed files with 26 additions and 41 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tests/model_executor/test_forward_meta_str.py
View File

@@ -30,6 +30,7 @@ class TOYGPUModelRunner:
self.pre_max_block_num = 16
# Not the tensor in real sense, just for make ForwardMeta
self.share_inputs = {}
self.share_inputs["input_ids"] = paddle.full(
[self.max_num_seqs, self.max_model_len],
0,
@@ -63,7 +64,6 @@ class TOYGPUModelRunner:
"""
# Ignore the attentionbackbend for simplify
self.forward_meta = ForwardMeta(
input_ids=self.share_inputs["input_ids"],
ids_remove_padding=self.share_inputs["ids_remove_padding"],
# rotary_embs=self.share_inputs["rope_emb"],# Ignore the rope_emb for simplify
# attn_backend=self.attn_backends[0],# Ignore the attn_backbend for simplify