MediaSession for playing music preventing standby and handling MediaButton events on Android

[sandreas]

Hello,

I would like to implement an audio player in Tauri, that keeps playing without getting aborted by the Android device getting into standby or something. Furthermore I would like to implement specific click handlers that are not in the official MediaButton specification (e.g. tap-longpress for fastforward, tap-tap-longpress for rewind). Unfortunately longpress is not supported by the WebViews Mediasession or any key-handler that works while playing in background.

Therefore I would like to react on KeyUp and KeyDown events from Headset remot buttons to handle longpresses.

I found this capacitor plugin discussion which seems to solve exactly the problem I'm talking about, unfortunately I don't know how I could transfer this to Tauri / Rust:
#12616

I would love to see an example on how to do this with at least a few bits of code to have a starting point. Common LLMs just hallucinate about this topic.

Can anybody help me?

[FabianLars]

There's no example/guide on how to port capacitor plugins. You first follow https://v2.tauri.app/develop/plugins/ until you have a base project. Then the android files from https://github.com/jofr/capacitor-media-session/tree/main/android/src/main/java/io/github/jofr/capacitor/mediasessionplugin and the AndroidManifest.xml file can mostly be copy-pasted while adapting the package names. The ...Plugin.java file needs a few more modifications to change PluginCall to tauri's invoke/channel apis. You can check a few plugins in https://github.com/tauri-apps/plugins-workspace/ for reference.
The js types can probably be copied, just the apis themselves need to use invoke etc.

[sandreas]

@FabianLars

Thanks for your response. Yeah I understand the general approach... The problem lies in the details.

My main project has a android mainactivity, but I did not find out how to access the tauri webview

I tried to create a tauri-plugin and link it locally into the main project for easier testing but I did not find out how to tie the webview to the activities / rust parts.

I try to provide a code example, maybe this would ease up providing help or advice ;-)

[sandreas]

@FabianLars
So here is the test project's relevant commit: sandreas/tauri-test@83e062c

What I'm trying to do is having the tauri-appload the plugin tauri-plugin-mediabutton, which uses webView.postWebMessageeverytime I press a button on my headphone remote or media button. For easier testing I integrated "message from kotlin" also in the load method.

Would this be the correct approach to integrate such a plugin? Or am I missing something?
Feel free to either explain, point me to the documentation or create a pull request for the project - thank you for your help.