Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model does not appear to have a file named config.json #4634

Closed
minh282906 opened this issue Dec 25, 2023 · 16 comments
Closed

Model does not appear to have a file named config.json #4634

minh282906 opened this issue Dec 25, 2023 · 16 comments

Comments

@minh282906
Copy link

minh282906 commented Dec 25, 2023

I run normal make in WSL2 Linux/Ubuntu
and download model 7B and 7B-chat in https://ai.meta.com/resources/models-and-libraries/llama-downloads/
already have env in anaconda env and run requirements file to install all the needs
when I run python3 convert.py models/... to convert to ggml FP16 format it return error
"raise EnvironmentError(
OSError: llama/llama-2-7b does not appear to have a file named config.json. Checkout 'https://huggingface.co/llama/llama-2-7b/None' for available files."
how do I fix this issue

@Denzy7
Copy link

Denzy7 commented Dec 26, 2023

You might need this config.json in your mixtral-8x7b-32kseqlen folder

@minh282906
Copy link
Author

You might need this config.json in your mixtral-8x7b-32kseqlen folder

Could you please provide further clarification?

@luopeihai
Copy link

luopeihai commented Dec 27, 2023

hi, I have the same issue. Someone solved it ?

image

@minh282906
Copy link
Author

hi, I have the same issue. Someone solved it

image

wow thank you very much

@minh282906
Copy link
Author

minh282906 commented Dec 27, 2023

hi, I have the same issue. Someone solved it

image

where is the 7B folder in models folder, and what inside the 7B folder

@wailu
Copy link

wailu commented Dec 28, 2023

@minh282906 it seems you first have to convert the llama weights to hf (see: https://huggingface.co/docs/transformers/model_doc/llama2#usage-tips)

Screenshot 2023-12-28 at 3 44 39 PM

@minh282906
Copy link
Author

@wailu

A few weeks ago, I ran it normally, I didn't need to convert to hf. But now I am encountering this error, so that's why I find it really strange.

@sergiocardoso
Copy link

same to me :(

@minh282906
Copy link
Author

@sergiocardoso
why did this happen :((

@dpaksahoo
Copy link

I'm also facing the same issue, any fixes @minh282906 ?

@minh282906
Copy link
Author

@dpaksahoo
No, I don't

@sergiocardoso
Copy link

Sorry for my english.
A solution that I found was checkout to this branch
git checkout 0353a1840134b24b07ab61fd4490192f28c4db6b

#4493 (comment)

@minh282906
Copy link
Author

@sergiocardoso

Thank you very much

@dpaksahoo
Copy link

@sergiocardoso thank you, this worked for me 💯

Copy link
Contributor

This issue is stale because it has been open for 30 days with no activity.

@github-actions github-actions bot added the stale label Mar 18, 2024
Copy link
Contributor

github-actions bot commented Apr 2, 2024

This issue was closed because it has been inactive for 14 days since being marked as stale.

@github-actions github-actions bot closed this as completed Apr 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants