Skip to content

Commit

Permalink
fix code format
Browse files Browse the repository at this point in the history
Signed-off-by: yuwenzho <[email protected]>
  • Loading branch information
yuwenzho committed Oct 25, 2024
1 parent 9747a8a commit 5b4a86b
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion vllm/worker/hpu_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -352,7 +352,8 @@ def _update_metadata(self, attn_metadata, batch_size, seq_len, device,
def forward(self, *args, **kwargs):
kwargs = kwargs.copy()
selected_token_indices = kwargs.pop('selected_token_indices')
warmup_mode = kwargs.pop('warmup_mode') if 'warmup_mode' in kwargs else None
warmup_mode = kwargs.pop(
'warmup_mode') if 'warmup_mode' in kwargs else None
input_ids = kwargs['input_ids']
kwargs['attn_metadata'] = self._update_metadata(
kwargs['attn_metadata'], input_ids.size(0), input_ids.size(1),
Expand Down

0 comments on commit 5b4a86b

Please sign in to comment.