Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SYCL]set context default value to avoid memory issue, update guide #9476

Merged
merged 2 commits into from
Sep 18, 2024

Conversation

NeoZhangJianyu
Copy link
Collaborator

  1. Update run-llama2.sh, set context with default value 8192 to avoid memory out of resource issue.
  2. Update the SYCL.md with memory out of resource Q&A.

@github-actions github-actions bot added documentation Improvements or additions to documentation examples SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language labels Sep 14, 2024
docs/backend/SYCL.md Outdated Show resolved Hide resolved
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
@NeoZhangJianyu NeoZhangJianyu merged commit faf67b3 into master Sep 18, 2024
8 checks passed
dsx1986 pushed a commit to dsx1986/llama.cpp that referenced this pull request Oct 29, 2024
…gerganov#9476)

* set context default to avoid memory issue, update guide

* Update docs/backend/SYCL.md

Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>

---------

Co-authored-by: arthw <14088817+arthw@users.noreply.github.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
arthw added a commit to arthw/llama.cpp that referenced this pull request Nov 15, 2024
…gerganov#9476)

* set context default to avoid memory issue, update guide

* Update docs/backend/SYCL.md

Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>

---------

Co-authored-by: arthw <14088817+arthw@users.noreply.github.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
arthw added a commit to arthw/llama.cpp that referenced this pull request Nov 18, 2024
…gerganov#9476)

* set context default to avoid memory issue, update guide

* Update docs/backend/SYCL.md

Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>

---------

Co-authored-by: arthw <14088817+arthw@users.noreply.github.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation examples SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants