You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
bark.cpp/build/examples/main/main binary doesn't use GPU, it only uses CPU as far as i can see.
I am not sure, why my GPU is not utilized to any extent...
root@thom:~/app/bark.cpp# ./build/examples/main/main -m ./models/bark-small/ggml_weights.bin -p "this is an audio generated by bark.cpp" -t 4
██████╗ █████╗ ██████╗ ██╗ ██╗ ██████╗██████╗ ██████╗
██╔══██╗██╔══██╗██╔══██╗██║ ██╔╝ ██╔════╝██╔══██╗██╔══██╗
██████╔╝███████║██████╔╝█████╔╝ ██║ ██████╔╝██████╔╝
██╔══██╗██╔══██║██╔══██╗██╔═██╗ ██║ ██╔═══╝ ██╔═══╝
██████╔╝██║ ██║██║ ██║██║ ██╗██╗╚██████╗██║ ██║
╚═════╝ ╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═╝╚═╝ ╚═════╝╚═╝ ╚═╝
encodec_load_model_weights: using CPU backend
encodec_load_model_weights: model size = 44.36 MB
bark_tokenize_input: prompt: 'this is an audio generated by bark.cpp'
bark_tokenize_input: number of tokens in prompt = 513, first 8 tokens: 20579 20172 20199 33733 58966 20203 28169 20222
Generating semantic tokens... 78%
bark_print_statistics: sample time = 75.15 ms / 600 tokens
bark_print_statistics: predict time = 5390.09 ms / 8.98 ms per token
bark_print_statistics: total time = 5476.48 ms
Building process for GPU access; btw yet GPU is not working
Also, I changed two lines manually in the following files.
File: bark.cpp/bark.cpp
You also need to modify bark.cpp line 826
model.backend = ggml_backend_cuda_init();
by model.backend = ggml_backend_cuda_init(0);
File: bark.cpp/encodec.cpp/encodec.cpp
You also need to modify encodec.cpp line 215
model.backend = ggml_backend_cuda_init();
by model.backend = ggml_backend_cuda_init(0);
After the above changes I built through the following GPU command,
bark.cpp/build/examples/main/main binary doesn't use GPU, it only uses CPU as far as i can see.
I am not sure, why my GPU is not utilized to any extent...
Building process for GPU access; btw yet GPU is not working
Also, I changed two lines manually in the following files.
File: bark.cpp/bark.cpp
You also need to modify bark.cpp line 826
model.backend = ggml_backend_cuda_init();
by model.backend = ggml_backend_cuda_init(0);
File: bark.cpp/encodec.cpp/encodec.cpp
You also need to modify encodec.cpp line 215
model.backend = ggml_backend_cuda_init();
by model.backend = ggml_backend_cuda_init(0);
After the above changes I built through the following GPU command,
The text was updated successfully, but these errors were encountered: