Java maven artifact planned?

[ChristianMueller2]

Hi all,

are there any plans to publish a artifact into the public maven repository?

[natke]

It is not on the immediate roadmap. Can you tell us more about your scenario?

[ChristianMueller2]

Hi natke,
I used this nuget package already in an .NET environment to run locally LMs.

We are looking to integrate this functionality into our Java-based applications. Currently, we can only find the ONNX Runtime package in the Maven repository, and it would be much more convenient if the GenAI package could also be downloaded via Maven rather than building it manually.

This would streamline our development process and ensure consistency across our projects. Could you please consider adding this to your roadmap?

Thank you!

[baijumeswani]

@ChristianMueller2 while not the most convenient, we do have prebuilt android packages available in our github release downloads: https://github.com/microsoft/onnxruntime-genai/releases/tag/v0.7.1

Not sure if that would work. If not, we can add this to our roadmap for future releases (perhaps post 0.8.0 release).

[ChristianMueller2]

@baijumeswani thank you a maven artifact wpuld be the best. ButI will take a look into the android package.

Sorry for my late response :)

[asoldano]

hi, before noticing this discussion, I opened #1496 which is about installing the java maven artifact into the local maven repository as part of the build. That is basically the first step in enabling proper usage scenarios for the java version of this library. Maven is the de-fact standard for building java projects; you specify dependencies versions in your project pom.xml and Maven goes and fetch the artifacts by looking into the local repository first and remote repos afterwards.
@baijumeswani , I'm +100 on adding this to the roadmap, it's fundamental for enabling consumption of project in the Java world.

For the records, I'm starting working on langchain4j/langchain4j#2669 in my spare time and that would require onnxruntime-genai to be available in a maven repository (ideally maven central).

[david-sitsky]

I'd love to see Java Maven packages done as well. It will ease adpotion.

[david-sitsky]

Just to re-enforce the request to automatically create maven artifacts for Onnxruntime GenAI. DJL (Deep Java Learning) the an advanced Java-based deep-learning framework that supports multiple engines, including Onnxruntime. Frank Liu is keen to add in support for Onnxruntime GenAI, but adding in Java maven support would be a requirement ideally to make this automated.

This will increase expose / usage of Onnx GenAI significantly. Can we give this priority please?

deepjavalibrary/djl#3735 (comment)

[frankfliu]

Is that possible to publish jni library to github when you publish release?

[asoldano]

@natke @baijumeswani now that 0.9.0 is out, is there any news on when the full java maven artifact publishing will be worked? If you have the next steps in mind for how you'd like that to be implemented, how about you create issue tickets for volunteers to work on? If you need to brainstorm, I (or others here) might be able to help.