remove input_ids from ForwardMeta (#4793)
Some checks failed
CE Compile Job / ce_job_pre_check (push) Has been cancelled
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
CE Compile Job / Show Code Archive Output (push) Has been cancelled
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Deploy GitHub Pages / deploy (push) Has been cancelled

This commit is contained in:
周周周
2025-11-05 11:55:51 +08:00
committed by GitHub
parent 9676cc87d6
commit 876e4a8935
13 changed files with 26 additions and 41 deletions

View File

@@ -65,8 +65,6 @@ class ForwardMeta:
ForwardMeta is used to store the global meta information of the model forward.
"""
# Input tokens IDs
input_ids: paddle.Tensor
# Input tokens IDs of removed padding
ids_remove_padding: paddle.Tensor
# Rotation position embedding
@@ -265,7 +263,7 @@ class HPUForwardMeta(ForwardMeta):
"""
#
input_ids: paddle.Tensor
input_ids: paddle.Tensor = None
# attention meta
forward_mode: ForwardMode = ForwardMode.MIXED