Skip to content

Releases: huningxin/tflite-support

Preview of TFLite Web API with WebNN delegate 0.1.0

14 Oct 02:24

Choose a tag to compare

This version of TFLite Web API Model Runner demo uses the preview of WebNN delegate to access OS ML APIs through WebNN API.

The dmeo supports selecting WebNN backend with GPU or CPU device preference:

image

When running in Electron.js on Ubuntu Linux, the GPU-WebNN and CPU-WebNN backend is based on OpenVINO GPU and CPU plugin through WebNN-native node.js binding.

Download the packaged Electron.js app tflite-web-api-model-runner-demo-linux-x64.tar.gz, unzip it and run demo-launcher.

tar zxvf tflite-web-api-model-runner-demo-linux-x64.tar.gz
cd tflite-web-api-model-runner-demo-linux-x64/
./demo-launcher

Note: You may need to install OpenVINO dependencies as below

cd tflite-web-api-model-runner-demo-linux-x64
sudo -E resources/app/node_modules/webnn-node/install_dependencies/install_openvino_dependencies.sh
sudo -E resources/app/node_modules/webnn-node/install_dependencies/install_NEO_OCL_driver.sh