Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing log trampoline #155

Open
thewh1teagle opened this issue May 31, 2024 · 1 comment
Open

Missing log trampoline #155

thewh1teagle opened this issue May 31, 2024 · 1 comment

Comments

@thewh1teagle
Copy link
Contributor

When using latest whisper-rs with log-trampoline feature some of the logs are still shown in stderr as normal from whisper.cpp

ggml_opencl: selecting platform: 'AMD Accelerated Parallel Processing'
ggml_opencl: selecting device: 'gfx902'
full log
target\debug>set RUST_LOG=whisper_rs=debug

target\debug>vibe-desktop.exe --model "ggml-medium.bin" --file ..\..\samples\short.wav
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_init_from_file_with_params_no_state: loading model from 'C:\Users\User\AppData\Local\github.com.thewh1teagle.vibe\ggml-medium.bin'
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_init_with_params_no_state: use gpu    = 0
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_init_with_params_no_state: flash attn = 0
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_init_with_params_no_state: gpu_device = 0
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_init_with_params_no_state: dtw        = 0
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: loading model
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_vocab       = 51865
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_audio_ctx   = 1500
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_audio_state = 1024
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_audio_head  = 16
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_audio_layer = 24
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_text_ctx    = 448
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_text_state  = 1024
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_text_head   = 16
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_text_layer  = 24
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_mels        = 80
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: ftype         = 1
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: qntvr         = 0
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: type          = 4 (medium)
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: adding 1608 extra tokens
[2024-05-31T21:49:41Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: n_langs       = 99
ggml_opencl: selecting platform: 'AMD Accelerated Parallel Processing'
ggml_opencl: selecting device: 'gfx902'
[2024-05-31T21:49:42Z INFO  whisper_rs::whisper_sys_log] whisper_model_load:      CPU total size =  1533.14 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_model_load: model size    = 1533.14 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: kv self size  =  150.99 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: kv cross size =  150.99 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: kv pad  size  =    6.29 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: compute buffer (conv)   =   28.68 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: compute buffer (encode) =  594.22 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: compute buffer (cross)  =    7.85 MB
[2024-05-31T21:49:43Z INFO  whisper_rs::whisper_sys_log] whisper_init_state: compute buffer (decode) =  142.09 MB

I would love to fix it myself, but I've never played with trampolines ; ) a pointer can help.

@thewh1teagle thewh1teagle changed the title Missing long trampoline Missing log trampoline May 31, 2024
@hlhr202
Copy link
Contributor

hlhr202 commented Jun 4, 2024

I think currently there is no such way to trampoline opencl log. whisper.cpp doesn't allow setting a log callback in their code.
https://github.com/ggerganov/whisper.cpp/blob/af5833e29819810f2d83228228a9a3077e5ccd93/ggml-opencl.cpp#L1103

as a comparison, the ggml_metal backend allows this
https://github.com/ggerganov/whisper.cpp/blob/af5833e29819810f2d83228228a9a3077e5ccd93/ggml-metal.h#L43C15-L43C50

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants