Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cannot load model #49

Open
loekTheDreamer opened this issue Mar 27, 2024 · 4 comments
Open

cannot load model #49

loekTheDreamer opened this issue Mar 27, 2024 · 4 comments

Comments

@loekTheDreamer
Copy link

issue in the README regarding model loading. It mentions the 'gguf' model but lacks clear instructions. is file loading implemented yet? No model found is always result.

@ramyareye
Copy link

@loekTheDreamer I tried with downloading with https://lmstudio.ai/

@loekTheDreamer
Copy link
Author

when using the exmple project the models load fine.

But when adding the file to the project directory and using RNFS the error is always No model found :

    initLlama({
      model: `${RNFS.MainBundlePath}/gp2-q2_k.gguf`,
      // /Users/doris/Library/Developer/CoreSimulator/Devices/FB284989-91D5-4526-BC32-3B6CB88D84A7/data/Containers/Bundle/Application/70FB6F7D-3F5A-45DC-B21F-FEAEB2870926/Thailate.app/gp2-q2_k.gguf
      use_mlock: true,
      n_gpu_layers: Platform.OS === 'ios' ? 0 : 0, // > 0: enable GPU
      // embedding: true,
    })

@loekTheDreamer
Copy link
Author

please can someone provide feedback on this

@eagle705
Copy link

eagle705 commented Nov 7, 2024

I also failed to load model in simulator

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants