Unable to run onnxruntime-genai on iOS (Xcode 15.3)

Hello Team and @kinfey, Hope you're doing well.

I'm unable to run onnxruntime-genai for iOS using Xcode 15.3. I followed the steps mentioned in the demo and this Microsoft link, but the repository you referenced is unavailable (git checkout yguo/ios-build-genai). I proceeded with the main branch from GitHub and set everything up the same, but the application crashes on launch. Even your demo fails to run successfully.

FYI, I also tried the branch (git checkout yguo/chat-app-genai) available on the repo, but in this branch, none of the mentioned commands work, and no code can be executed.

I've attached a screenshot and crash logs from the console for reference. Could you please help with troubleshooting or guide me to resolve this crash? If you need additional details, I’ll be happy to share.

First Crash: /private/var/containers/Bundle/Application/8AC1B341-3A75-4806-AA85-8F61A506F689/OnnxModelFinal.app

Second Crash: libc++abi: terminating due to uncaught exception of type std::runtime_error: Error opening /private/var/containers/Bundle/Application/8AC1B341-3A75-4806-AA85-8F61A506F689/OnnxModelFinal.app/genai_config.json

Screenshot from Xcode console:

I added all the files correctly and set the path properly. After that, I encountered another error. Please check the screenshot.

Thank you!

[sahmed53]

Hi i am having the similar issues
Trying to follow the instructions here: https://github.com/Azure-Samples/Phi-3MiniSamples/blob/main/ios/README.md

this doesnt exist -> git checkout yguo/ios-build-genai

and so this step fails ->
python3 build.py --parallel --build_dir ./build_ios_simulator --ios --ios_sysroot iphoneos --osx_arch arm64 --apple_deployment_target 17.4 --cmake_generator Xcode

I could just use the example project but the library is dynamic (.dylib) and apparently these can't be shipped in iOS apps for the app store.

If there a way to build and use a static library/framework so we can use genAI on iOS?

Any help is appreciated (should i make a new issue as the original post is quite old now)