Skip to content

Commit

Permalink
llama : add assert
Browse files Browse the repository at this point in the history
  • Loading branch information
ggerganov authored Mar 29, 2024
1 parent 61f0ae7 commit d907f70
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions llama.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -5523,6 +5523,7 @@ static void llm_build_kv_store(
GGML_ASSERT(kv.size == n_ctx);

// compute the transposed [n_tokens, n_embd] V matrix
assert(v_cur->ne[0] == n_embd_v_gqa && v_cur->ne[1] == n_tokens);
struct ggml_tensor * v_cur_t = ggml_transpose(ctx, v_cur);
cb(v_cur_t, "v_cur_t", il);

Expand Down

0 comments on commit d907f70

Please sign in to comment.