support GPU or not ?

[EricKong1985]

I have checked the project description that :
The main goal of bark.cpp is to synthesize audio from a textual input with the Bark model in efficiently using only CPU.

Could I know the it support GPU or not ? I suppose that using GPU should be more faster that using CPU

[PABannier]

Hi @EricKong1985 ! We could support GPU with OpenCL. Currently, we are focusing on removing any bugs from the library and making it fast for CPU. If you're willing to add support for GPUs, I'm happy to guide you in the process.

[PABannier]

TODO: Support ggml-cuda for GPU acceleration

[crackedpotato007]

Any updates on this?

[PABannier]

@arnav7633 I have this ongoing PR #124 to integrate the latest changes from encodec.cpp and ggml (which includes ggml-cuda). Currently, I do not have time to merge it, but I plan to do it by the end of the year.

[PABannier]

@crackedpotato007 @EricKong1985 The support for GPU has landed with CUDA and #139 . If you want to give it a try, i'd be happy to have your feedbacks

[crackedpotato007]

Extremely sorry, for being... a few months late.

Had my uni exams so i was rarely checking my notifs or bothering to reply to them. How do i go about using the GPU? Running the interference in the examples section doesn't use my GPU at all