Usage issue with Obsidian.md (path .wasm)

[louis030195]

Hi, I'm trying to use onnxruntime in a https://obsidian.md plugin

const [modelPath, setModelPath] = React.useState("/Users/l/Downloads");
const initializeWorkers = async () => {
    const imageModelUrl = "clip-image-vit-32-float32.onnx"
    const textModelUrl = "clip-text-vit-32-float32-int32.onnx"
    if (!fs.existsSync(`${modelPath}/${imageModelUrl}`)) {
      const imageOnnxBlobPromise = downloadBlobWithProgress("https://huggingface.co/rocca/openai-clip-js/resolve/main/clip-image-vit-32-float32.onnx", (e) => {}, imageModelUrl);

      const textOnnxBlobPromise = downloadBlobWithProgress("https://huggingface.co/rocca/openai-clip-js/resolve/main/clip-text-vit-32-float32-int32.onnx", (e) => {}, textModelUrl);

      const [imageOnnxBlob, textOnnxBlob] = await Promise.all<Blob>([imageOnnxBlobPromise, textOnnxBlobPromise])
    }

    const numImageWorkers = Number(numThreads);
    
    const imageModelExecutionProviders = ["wasm"];
    for (let i = 0; i < numImageWorkers; i++) {
      const session = await ort.InferenceSession.create(`${modelPath}/${imageModelUrl}`,
       { executionProviders: imageModelExecutionProviders });
      onnxImageSessions.push(session);
      imageWorkers.push({
        session,
        busy: false,
      });
    }
    onnxTextSession = await ort.InferenceSession.create(`${modelPath}/${textModelUrl}`, { executionProviders: ["wasm"] });
    window.URL.revokeObjectURL(imageModelUrl);
    window.URL.revokeObjectURL(textModelUrl);

    const Tokenizer = (await import("https://deno.land/x/[email protected]/mod.js")).default;
    textTokenizer = new Tokenizer();

    const vips = await Vips();
}

But I have an issue related to path, onnxruntime seems to try to get the .wam from onnxruntime-web?

VM320:36383 Fetch API cannot load app://ort-wasm-threaded.wasm/. URL scheme must be "http" or "https" for CORS request.
eval @ VM320:36383
r @ VM320:36388
eval @ VM320:48730
eval @ VM320:48713
eval @ VM320:63
__async @ VM320:47
t.initializeWebAssembly @ VM320:48686
eval @ VM320:48242
eval @ VM320:63
__async @ VM320:47
t.initWasm @ VM320:48228
eval @ VM320:40023
eval @ VM320:63
__async @ VM320:47
init @ VM320:40022
eval @ VM320:35512
eval @ VM320:63
__async @ VM320:47
eval @ VM320:35501
eval @ VM320:35521
eval @ VM320:63
__async @ VM320:47
create @ VM320:35460
eval @ VM320:63765
eval @ VM320:63
__async @ VM320:47
initializeWorkers @ VM320:63736
onClick @ VM320:63816
callCallback2 @ VM320:7403
invokeGuardedCallbackDev @ VM320:7428
invokeGuardedCallback @ VM320:7462
invokeGuardedCallbackAndCatchFirstError @ VM320:7465
executeDispatch @ VM320:10500
processDispatchQueueItemsInOrder @ VM320:10520
processDispatchQueue @ VM320:10529
dispatchEventsForPlugins @ VM320:10537
eval @ VM320:10661
batchedUpdates$1 @ VM320:22091
batchedUpdates @ VM320:7308
dispatchEventForPluginEventSystem @ VM320:10660
dispatchEventWithEnableCapturePhaseSelectiveHydrationWithoutDiscreteEventReplay @ VM320:8991
dispatchEvent @ VM320:8985
dispatchDiscreteEvent @ VM320:8962
Show 13 more frames
VM320:35520 Uncaught (in promise) Error: no available backend found. ERR: [wasm] TypeError: Failed to fetch
at Function.eval (eval at (app.js:1), :35520:21)
at Generator.throw ()
at rejected (eval at (app.js:1), :57:29)

Here I see some hints of where it's looking for the path

onnxruntime/js/web/script/build.ts

Line 33 in 893ee65

const WASM_BINDING_FOLDER = path.join(__dirname, '..', 'lib', 'wasm', 'binding');

I'm not really sure how to work around this, I guess it's because Obsidian have a specific way to work with dependencies path, maybe
https://forum.obsidian.md/t/inter-plugin-communication-expose-api-to-other-plugins/23618
https://forum.obsidian.md/t/the-import-of-third-party-module-is-failing-in-main-js-cannot-find-module/25180

Do you have any idea of what I could try to solve this problem?

Thanks!