Please update onnxruntime-android for full 16 KB page-size support

[ss-stanislavsky]

Hi 👋

Thanks a lot for adding 16 KB page-size support in the latest release by upgrading to NDK r28b.
However, the library still uses onnxruntime-android:1.17.0, which does not include full support for 16 KB page-size.

According to onnxruntime issue #24902
, the JNI layer (libonnxruntime4j_jni.so) also needs to be rebuilt for 16 KB page-size.
This was fixed in PR #24947
and is available in newer onnxruntime releases (≥ 1.20.x).

Suggested fix:

Bump the dependency to a newer onnxruntime-android version (1.20.x or newer) where the JNI layer supports 16 KB page-size.

Optionally allow overriding the onnxruntime version via Gradle for downstream projects.

This will ensure that Sentence-Embeddings-Android works correctly on devices with 16 KB page-size and prevents runtime crashes.

Thanks! 🙏

[shubham0204]

Thank you @ss-stanislavsky for the information.

I have bumped the onnxruntime-android package version to 1.23.0.

Optionally allow overriding the onnxruntime version via Gradle for downstream projects.

How does one achieve that in Gradle? It would be great if you can point me to some examples or docs.

[ss-stanislavsky]

Hi 👋

Thanks again for bumping the onnxruntime-android version in the source code.

I noticed that a new release containing this change has not been published yet. Could you please publish a new release (e.g., v6.1) with onnxruntime-android:1.23.0? This will allow downstream projects to automatically get the updated version via Gradle.

Regarding your question about allowing downstream projects to override the onnxruntime version:

A common approach is to declare onnxruntime as a api or implementation dependency using a variable or Gradle property. For example, in your library’s build.gradle.kts:

val onnxVersion: String by project.extra // read from project property or default

dependencies {
    implementation("com.microsoft.onnxruntime:onnxruntime-android:$onnxVersion")
}

Then downstream projects can override it in their gradle.properties or in their own build script:

# gradle.properties
onnxVersion=1.23.0

Or directly in dependencies using constraints / force:

dependencies {
    implementation("io.gitlab.shubham0204:sentence-embeddings:v6")
    implementation("com.microsoft.onnxruntime:onnxruntime-android:1.23.0") {
        force = true
    }
}

This way, downstream projects can easily pick a newer onnxruntime version without modifying your library source code.

In fact, in my own project, I already bumped the onnxruntime version this way by adding:

implementation("com.microsoft.onnxruntime:onnxruntime-android:1.23.0")

to my build.gradle.kts.

My project now uses the new version, replacing the version declared in the library, which ensures 16 KB page-size support on Android devices.

[shubham0204]

Followed this approach and made a commit:

A common approach is to declare onnxruntime as a api or implementation dependency using a variable or Gradle property.

Thank you for letting me know the approach!

[shubham0204]

There's a problem. I had designed the CI to publish both, sentence_embeddings and model2vec together on Maven Central, but I've only updated the sentence_embeddings module. I'll have to decouple the release process of both modules.