Skip to content

Commit

Permalink
Indent for cuda graphs caching
Browse files Browse the repository at this point in the history
  • Loading branch information
Nexesenex committed Aug 13, 2024
1 parent 8cb4552 commit 6e5663e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/llama.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -14984,7 +14984,7 @@ static int llama_decode_internal(
} else {
tmp_offset = (kv_head)*ggml_element_size(kv_self.v_l[il]);
}
node->src[1]->data = static_cast<char*>(tmp_tensor->data) + tmp_offset;
node->src[1]->data = static_cast<char*>(tmp_tensor->data) + tmp_offset;
}
}
}
Expand Down

0 comments on commit 6e5663e

Please sign in to comment.