-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Failing to unpickle the model #2464
Comments
Hi @ksajan! Could you provide a bit more context on the error that you're seeing from this? |
@ErikKaum Give me some time, I have deleted the folder and was testing other parts of it. So will take a little time to run this again |
@ErikKaum This is the entire logs
|
Thanks a lot for providing this info 👍 So one thing that's good mentioning is that Vicuna isn't a supported model. We try to support other ones by falling back to the transformers implementation, but it's not as smooth and there's a performance hit. However here the error seems to be Similarly above the log line
indicates that you probably should pass the And similarly as the other issue: without GPU, running this model might be a bit tough. Hopefully these help 👍 |
System Info
cargo version
cargo 1.80.1 (376290515 2024-07-16)
Haven't been able to run the docker file to get more details..
I am trying to run the docker on CPU
Information
Tasks
Reproduction
I ran the command
The text was updated successfully, but these errors were encountered: