Skip to content

Commit

Permalink
Small fix
Browse files Browse the repository at this point in the history
  • Loading branch information
Oscilloscope98 committed Dec 11, 2024
1 parent e0cddbb commit a278e19
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -110,7 +110,7 @@ std::string run_generate(void* void_model, int32_t* embd_inp_ptr, int32_t embd_i
printf("\nPrefill %d tokens cost %d ms.\n", embd_inp_size, duration.count());
}

std::vector<int32_t> embd; // output ids;
std::vector<int32_t> embd; // output ids
embd.push_back(token);

int token_nums = 0;
Expand Down

0 comments on commit a278e19

Please sign in to comment.