Skip to content

Commit

Permalink
quantize : use unused imatrix chunk_size with LLAMA_TRACE
Browse files Browse the repository at this point in the history
  • Loading branch information
compilade committed Sep 10, 2024
1 parent 8c13e16 commit 2d79a70
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/quantize/quantize.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -220,7 +220,7 @@ static int load_imatrix(const std::string & imatrix_file, std::string & imatrix_
}
}
if (getenv("LLAMA_TRACE")) {
printf("%s: loaded data (size = %6d, n_tokens = %6d) for '%s'\n", __func__, int(e.size()), int(max_count), name.c_str());
printf("%s: loaded data (size = %6d, n_tokens = %6d, n_chunks = %6d) for '%s'\n", __func__, int(e.size()), int(max_count), int(max_count / chunk_size), name.c_str());
}
}

Expand Down

0 comments on commit 2d79a70

Please sign in to comment.