Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add support for new whisper.cpp project structure #169

Merged
merged 3 commits into from
Sep 1, 2024

Conversation

arizhih
Copy link
Contributor

@arizhih arizhih commented Aug 8, 2024

Add support for new whisper.cpp project structure
Remove opencl feature, removed in whisper.cpp
Add openmp feature and enable by default as in whisper.cpp
Update bindings

Remove opencl feature, removed in whisper.cpp
Add openmp feature and enable by default as in whisper.cpp
Update bindings
@arizhih arizhih mentioned this pull request Aug 9, 2024
@thewh1teagle
Copy link
Contributor

Hey
Do you know if there's any way to optimize it on Windows now that OpenCL removed?

@arizhih
Copy link
Contributor Author

arizhih commented Aug 13, 2024

Hi, as I understand they removed it in favor of Vulkan, @newfla already did pr #168

@tazz4843
Copy link
Owner

tazz4843 commented Sep 1, 2024

New major release of whisper-rs will depend on #168 then if OpenCL is gone

@tazz4843 tazz4843 merged commit 8596d2d into tazz4843:master Sep 1, 2024
13 checks passed
@thewh1teagle
Copy link
Contributor

Since this update it works 2 times slower on macOS even when coreml and metal features enabled. Any idea why? maybe it doesn't enable it?

@arizhih
Copy link
Contributor Author

arizhih commented Sep 13, 2024

@thewh1teagle
Hi, what about windows/linux on GPU/CPU? Maybe they changed default values for parameters? Do you have any logs?

Maybe it'll be better to create separate issue to continue?

@thewh1teagle
Copy link
Contributor

Hi, what about windows/linux on GPU/CPU?

On Linux / Windows it of course works much faster with Vulkan. the problem is with macOS arm.
Created #176

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants