[BUG] Keyboard Shortcut not working Ubuntu 22.04

[nikolayhg]

Bug Description

I press the shortcut in an input field, speak, release the keys, nothing happens.

System Information

0.3.9

$ dpkg -l | grep libglib2.0-0
ii  libglib2.0-0t64:amd64                          2.80.0-6ubuntu3.4                        amd64        GLib library of C routines
$ dpkg -l | grep gvfs
ii  gvfs:amd64                                     1.54.0-1ubuntu2                          amd64        userspace virtual filesystem - GIO module
ii  gvfs-backends                                  1.54.0-1ubuntu2                          amd64        userspace virtual filesystem - backends
ii  gvfs-common                                    1.54.0-1ubuntu2                          all          userspace virtual filesystem - common data files
ii  gvfs-daemons                                   1.54.0-1ubuntu2                          amd64        userspace virtual filesystem - servers
ii  gvfs-fuse                                      1.54.0-1ubuntu2                          amd64        userspace virtual filesystem - fuse server
ii  gvfs-libs:amd64                                1.54.0-1ubuntu2                          amd64        userspace virtual filesystem - private lib

$ ll /lib/x86_64-linux-gnu/libglib*
-rw-r--r-- 1 root root 2369830 May 15 15:06 /lib/x86_64-linux-gnu/libglib-2.0.a
lrwxrwxrwx 1 root root      16 May 15 15:06 /lib/x86_64-linux-gnu/libglib-2.0.so -> libglib-2.0.so.0
lrwxrwxrwx 1 root root      23 May 15 15:06 /lib/x86_64-linux-gnu/libglib-2.0.so.0 -> libglib-2.0.so.0.8000.0
-rw-r--r-- 1 root root 1343056 May 15 15:06 /lib/x86_64-linux-gnu/libglib-2.0.so.0.8000.0
$ nm -D /lib/x86_64-linux-gnu/libglib-2.0.so.0.8000.0 | grep g_task_set_static_name
$ nm -D /lib/x86_64-linux-gnu/libglib-2.0.so.0 | grep g_task_set_static_name
$

Operating System:
Ubuntu 24.04

CPU:
11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz

GPU:
Intel TigerLake-LP GT2 [Iris Xe Graphics] driver: i915 v: kernel

Log:

/usr/lib/x86_64-linux-gnu/gvfs/libgvfscommon.so: undefined symbol: g_task_set_static_name
Failed to load module: /usr/lib/x86_64-linux-gnu/gio/modules/libgvfsdbus.so
/usr/lib/x86_64-linux-gnu/gvfs/libgvfscommon.so: undefined symbol: g_task_set_static_name
Failed to load module: /usr/lib/x86_64-linux-gnu/gio/modules/libgvfsdbus.so
Loading transcription model small from: /home/userrr/.local/share/com.pais.handy/models/ggml-small.bin
whisper_init_from_file_with_params_no_state: loading model from '/home/userrr/.local/share/com.pais.handy/models/ggml-small.bin'
whisper_init_with_params_no_state: use gpu    = 1
whisper_init_with_params_no_state: flash attn = 0
whisper_init_with_params_no_state: gpu_device = 0
whisper_init_with_params_no_state: dtw        = 0
Using device: Ok("default")
Sample rate: 16000
Channels: 1
Format: U8
ggml_vulkan: Found 1 Vulkan devices:
Vulkan0: Intel(R) Xe Graphics (TGL GT2) (Intel open-source Mesa driver) | uma: 1 | fp16: 1 | warp size: 32
whisper_init_with_params_no_state: backends   = 2
whisper_model_load: loading model
whisper_model_load: n_vocab       = 51865
whisper_model_load: n_audio_ctx   = 1500
whisper_model_load: n_audio_state = 768
whisper_model_load: n_audio_head  = 12
whisper_model_load: n_audio_layer = 12
whisper_model_load: n_text_ctx    = 448
whisper_model_load: n_text_state  = 768
whisper_model_load: n_text_head   = 12
whisper_model_load: n_text_layer  = 12
whisper_model_load: n_mels        = 80
whisper_model_load: ftype         = 1
whisper_model_load: qntvr         = 0
whisper_model_load: type          = 3 (small)
whisper_model_load: adding 1608 extra tokens
whisper_model_load: n_langs       = 99
whisper_model_load:  Vulkan0 total size =   487.01 MB
whisper_model_load: model size    =  487.01 MB
whisper_backend_init_gpu: using Vulkan backend
whisper_init_state: kv self size  =   18.87 MB
whisper_init_state: kv cross size =   56.62 MB
whisper_init_state: kv pad  size  =    4.72 MB
whisper_init_state: compute buffer (conv)   =   23.37 MB
whisper_init_state: compute buffer (encode) =  128.01 MB
whisper_init_state: compute buffer (cross)  =    6.18 MB
whisper_init_state: compute buffer (decode) =   98.19 MB
Found existing settings: AppSettings { bindings: {"transcribe": ShortcutBinding { id: "transcribe", name: "Transcribe", description: "Converts your speech into text.", default_binding: "ctrl+space", current_binding: "ctrl+space" }}, push_to_talk: true, audio_feedback: false, selected_model: "small", always_on_microphone: true, selected_microphone: None, selected_output_device: None, translate_to_english: false, selected_language: "auto", overlay_position: Bottom, debug_mode: false, custom_words: [], model_unload_timeout: Never, word_correction_threshold: 0.18 }
/usr/lib/x86_64-linux-gnu/gvfs/libgvfscommon.so: undefined symbol: g_task_set_static_name
Failed to load module: /usr/lib/x86_64-linux-gnu/gio/modules/libgvfsdbus.so
/usr/lib/x86_64-linux-gnu/gvfs/libgvfscommon.so: undefined symbol: g_task_set_static_name
Failed to load module: /usr/lib/x86_64-linux-gnu/gio/modules/libgvfsdbus.so
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM pulse
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM jack
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss
ALSA lib pcm.c:2721:(snd_pcm_open_noupdate) Unknown PCM oss

** (handy:76678): WARNING **: 12:43:38.514: atk-bridge: get_device_events_reply: unknown signature

[cjpais]

Thanks for this issue. I am able to replicate this when using an AMD GPU on Ubuntu as well. Not sure why this is causing issues, but I will investigate further

[hanpham32]

I'm on Ubuntu 24.04 and Handy is not working for me. I installed the app via .deb file. I tried using the push to talk with default and different shortcuts but didn't work.

Pc spec:
GPU: Intel Corporation Meteor Lake-P [Intel Graphics]
CPU: Intel(R) Core(TM) Ultra 5 125U

[hanpham32]

I'm on Ubuntu 24.04 and Handy is not working for me. I installed the app via .deb file. I tried using the push to talk with default and different shortcuts but didn't work.

Pc spec: GPU: Intel Corporation Meteor Lake-P [Intel Graphics] CPU: Intel(R) Core(TM) Ultra 5 125U

The issue went away when I switched from Wayland to Xorg! Turns out the tauri-plugin-global-shortcut has limitations on Wayland

[cjpais]

Thanks for the note on Wayland vs Xorg in the plugin! That's super helpful.

I had some old code based on 'rdev' which may work more reliably on Linux for Xorg and Wayland. I'll try to get around to implement it again and feature flag it just for Linux for the time being. It may take me a bit to get to. Things are quite busy for me at the moment but maybe they will slow down again in a couple weeks.

Also happy to get any PRs around this as well!

[hanpham32]

oh what is rdev? @cjpais

[cjpais]

It's a library to listen to keyboard events. Though I did look and it does not have Wayland support

[cjpais]

I think this is an outdated dependency issue. I've updated the main branch which ideally should fix. Hopefully I can test on Wayland soon

[hanpham32]

@cjpais is the issue tested on Wayland yet?

[cjpais]

On the main branch I have updated the code, but I haven't had a chance to test yet. If you want to build from source and test that would be great

[hanpham32]

I'm on Wayland and running Handy built from source (on the latest commit 7732d20), and it looks like the wayland keys are still not detected. Even when inside the Handy application, pressing Handy shortcut doesn't trigger the recording.

[cjpais]

Dang okay, thanks for testing. I'll continue to look into it further. I do need help debugging it since Linux and Wayland are not my primary platform.

[cjpais]

@nikolayhg would you mind testing 0.5.3 and see if it improves for you? Also curious what happens if you disable the overlay? There have been some reports on linux that the overlay is taking the focus and not giving it back, so the paste is failing.

[pumello]

@cjpais I'm using Ubuntu 24.04 (by default uses Wayland) and have been waiting for this bug to be fixed to use your awesome tool :)

I tried 0.5.3, but it seems to still not work:

• I can set the Handy Shortcut to some key such as F9 (works)
• When I press F9 in another application, nothing happens (no overlay, nothing)

Also curious what happens if you disable the overlay?

If you meant the Overlay Position, I can set this to Top or None but there is no difference in the behaviour.

I'm curious if it's an issue of "Handy not being the active screen" and whether transcription actually works inside Handy itself, i.e. Handy being active, but there is no text box within Handy to try this on, and it seems not to do anything when I press F9 (no overlay or anything).