Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error: ‘ggml_flash_attn’ was not declared in this scope; did you mean ‘ggml_flash_attn_ext’? #456

Open
wr131 opened this issue Nov 10, 2024 · 4 comments

Comments

@wr131
Copy link

wr131 commented Nov 10, 2024

I complied this repositories on my Debian 12 PC,but it was failed.
error:

error: ‘ggml_flash_attn’ was not declared in this scope; did you mean ‘ggml_flash_attn_ext’?
  681 |     struct ggml_tensor* kqv = ggml_flash_attn(ctx, q, k, v, false);  // [N * n_head, n_token, d_head]
      |                               ^~~~~~~~~~~~~~~
      |                               ggml_flash_attn_ext'

parameters:
DGGML_AVX2 off SD_FLASH_ATTN on CXX_FLAGS=-march=ivybridge'

@Green-Sky
Copy link
Contributor

Yes, don't use SD_FLASH_ATTN. It stopped working early this year.

@truedat101
Copy link

yep

@leejet
Copy link
Owner

leejet commented Nov 23, 2024

Please use the latest code and update the ggml submodule.

@truedat101
Copy link

Thanks, will try tonight.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants