-
Notifications
You must be signed in to change notification settings - Fork 169
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
phi3 inference RuntimeError #1391
Comments
@khmyznikov I am unable to reproduce the issue with current head in Olive repo.
You mentioned something about making changes. Did you mean Olive dev making changes or did you make these changes. If the changes are local to you, could you share what you did? Here's the output from my local run from tip in Olive repo.
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug
After some of the changes, phi3 sample with inference flag stopped to work
Olive logs
Other information
The text was updated successfully, but these errors were encountered: