Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How can I use NPU to run Ollama on Intel Ultra7 155H chip in a laptop? #12504

Open
Muzixin opened this issue Dec 5, 2024 · 6 comments
Open

How can I use NPU to run Ollama on Intel Ultra7 155H chip in a laptop? #12504

Muzixin opened this issue Dec 5, 2024 · 6 comments
Labels
user issue

Comments

@Muzixin
Copy link

Muzixin commented Dec 5, 2024

No description provided.

@Muzixin
Copy link
Author

Muzixin commented Dec 5, 2024

Or how can I simultaneously use NPU and Arc GPU to run ollama？

@mordonez
Copy link

mordonez commented Dec 5, 2024

+1

@Oscilloscope98
Copy link
Contributor

Oscilloscope98 commented Dec 6, 2024 •
edited
Loading

We currently do not support Ollama on Intel NPU.

Please refer to our QuickStart for more information and any updates :)

@Muzixin
Copy link
Author

Muzixin commented Dec 6, 2024

@Oscilloscope98 Is there a support plan？

@Oscilloscope98
Copy link
Contributor

@Oscilloscope98 Is there a support plan？

We will look into it :)

@kitsuniru
Copy link

is there's any way to host a local NPU llm to use it with Continue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
user issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@mordonez @qiuxin2012 @Muzixin @kitsuniru @Oscilloscope98