Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] <title>what is happend #304

Open
mingyue0094 opened this issue Dec 6, 2024 · 1 comment
Open

[BUG] <title>what is happend #304

mingyue0094 opened this issue Dec 6, 2024 · 1 comment
Labels
🐞 bug Something isn't working

Comments

@mingyue0094
Copy link

Issue Description

This can't next setp, after down the model file

Steps to Reproduce

C:\Users\Administrator>
C:\Users\Administrator>nexa run Llama3.2-3B-Instruct:q4_0
Downloading Llama3.2-3B-Instruct/q4_0.gguf...
q4_0.gguf: 100%|████████████████████████████████████████████████████████████████████████████████████████████████| 1.79G/1.79G [03:37<00:00, 8.80MB/s]
Verifying download: 100%|████████████████████████████████████████████████████████████████████████████████████████| 1.79G/1.79G [00:02<00:00, 687MB/s]
Successfully downloaded Llama3.2-3B-Instruct/q4_0.gguf to C:\Users\Administrator\.cache\nexa\hub\official\Llama3.2-3B-Instruct\q4_0.gguf
Successfully pulled model Llama3.2-3B-Instruct:q4_0 to C:\Users\Administrator\.cache\nexa\hub\official\Llama3.2-3B-Instruct\q4_0.gguf, run_type: NLP
⠹

sleep ?

OS

win10

Python Version

no

Nexa SDK Version

Version 0.0.9.5; Last updated on Nov 25, 2024

GPU (if using one)

No response

@mingyue0094 mingyue0094 added the 🐞 bug Something isn't working label Dec 6, 2024
@zhycheng614
Copy link
Collaborator

Hi!

How long have you waited for the model to load? If you are not plugged in, or not using GPU, it may take long to load the model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐞 bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants