VAD fails to run on any iPhone browser, but works on Android

[crusherblack]

I am encountering an error when trying to run this on an iPhone using mobile browsers (Safari and Google Chrome). It works correctly on Android.

Here is the error message:

Encountered an error while loading model file https://cdn.jsdelivr.net/npm/@ricky0123/vad-web@latest/dist/silero_vad_legacy.onnx

[ricky0123]

Hi, do the demos on vad.ricky0123.com and test.vad.ricky0123.com work on your iphone? And can you tell me more about your setup? What versions of vad-web and onnxruntime are you using? Is there anything else in the console logs? Does the network tab show it trying to get the model file or worklet file and getting a 404?

[andrei4ik1997]

@crusherblack Hi, I had the same problem on iOS 17.6.1. After updating to iOS 18.7, the problem went away.

[Specy]

Trying on version 17.6.1 i get error:

3781-383912bbce115aff.js:2 Encountered an error while loading model file https://cdn.jsdelivr.net/npm/@ricky0123/vad-web@0.0.27/dist/silero_vad_v5.onnx
(anonymous) @ 3781-383912bbce115aff.js:2

251-959ca30bb41825c6.js:2 Unhandled Promise Rejection: Error: no available backend found. ERR: [wasm] RangeError: Out of memory, [cpu] Error: previous call to 'initWasm()' failed., [webnn] Error: previous call to 'initWasm()' failed., [webgpu] Error: prev...
(anonymous) @ 251-959ca30bb41825c6.js:2

Trying on https://test.vad.ricky0123.com i get generic:

[Error] Encountered an error while loading model file ./silero_vad_v5.onnx
	(anonymous function) (index.js:9972)
	asyncFunctionResume
	(anonymous function)
	promiseReactionJobWithoutPromise
	promiseReactionJob

@ricky0123

[Specy]

Looking at similar issues on other repos: huggingface/transformers.js#953 i'm guessing because of the lack of webgpu support in versions lower than 18.2 (i think that's when it was released?)

A pretty big chunk of ios users are still on ios 17, is there some workaround i can do other than downgrading the library to the previous version?

[Specy]

I'm guessing it's from this release of the onnx runtime:
https://github.com/microsoft/onnxruntime/releases/tag/v1.22.0

I tried setting the onnxWASMBasePath to onnx version 1.21.0 but that just made it not work at all for any platform as i get error

Uncaught (in promise) TypeError: n._OrtGetInputOutputMetadata is not a function
    at Tu (wasm-core-impl.ts:272:28)
    at Pt (wasm-core-impl.ts:421:48)
    at async bn.loadModel (session-handler-inference.ts:87:100)
    at async _n.createInferenceSessionHandler (backend-wasm.ts:91:5)
    at async e1.create (inference-session-impl.ts:212:21)
    at async push.SileroV5.new (v5.ts:24:22)
    at async AudioNodeVAD.new (real-time-vad.ts:264:15)
    at async MicVAD.new (real-time-vad.ts:148:26)
    at async run (src_components_aab29ea1._.js:8162:36)

[ricky0123]

@Specy onnxWASMBasePath is just the path that the onnxruntime library will use to fetch certain additional files. In order to use version 1.21.0 you would have to pin that in package.json. Could you try something like npm i onnxruntime-web@1.21.0 and then rebuild?

[Specy]

Ok yes setting the overrides:

  "overrides": {
    "onnxruntime-web": "^1.17.0",
  }

And the onnxWASMBasePath to 1.17.0 seems to work.

I tried with many versions and it seems like 1.17.0 is the only one that works on this target.

[ricky0123]

Got it, good to know, thanks

[pradeepruhil85]

Hi @ricky0123 @Specy , is there any luck on how to fix it with the latest version.
When I upgrade it on my Iphone 13, IOS 26, It works for the first time.. But when I try to start the session again, by destory the VAD and reinitalizing agian.. I get the same out of memory error,

3781-383912bbce115aff.js:2 Encountered an error while loading model file https://cdn.jsdelivr.net/npm/@ricky0123/vad-web@0.0.29/dist/silero_vad_v5.onnx
(anonymous) @ 3781-383912bbce115aff.js:2

251-959ca30bb41825c6.js:2 Unhandled Promise Rejection: Error: no available backend found. ERR: [wasm] RangeError: Out of memory, [cpu] Error: previous call to 'initWasm()' failed., [webnn] Error: previous call to 'initWasm()' failed., [webgpu] Error: prev...
(anonymous) @ 251-959ca30bb41825c6.js:2

Can you guyz help me what should i do, or I revert back to the legacy mode?