Skip to content

Commit

Permalink
Update ggml-backend-impl.h
Browse files Browse the repository at this point in the history
Co-authored-by: Johannes Gäßler <[email protected]>
  • Loading branch information
slaren and JohannesGaessler authored Mar 16, 2024
1 parent c0fe629 commit 8e717e8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ggml-backend-impl.h
Original file line number Diff line number Diff line change
Expand Up @@ -103,7 +103,7 @@ extern "C" {
// check if the backend supports an operation
bool (*GGML_CALL supports_op)(ggml_backend_t backend, const struct ggml_tensor * op);

// check if the backend want to run an operation, even if the weights are allocated in a CPU buffer
// check if the backend wants to run an operation, even if the weights are allocated in a CPU buffer
// these should be expensive operations with large batch sizes that may benefit from running on this backend
// even if the weight has to be copied from the CPU temporarily
bool (*GGML_CALL offload_op)(ggml_backend_t backend, const struct ggml_tensor * op);
Expand Down

0 comments on commit 8e717e8

Please sign in to comment.