Skip to content

WebNN: Reject batched MatMul with large K dimension size on OV NPU #57011

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
chromium-wpt-export-bot merged 1 commit into from
Jan 9, 2026

WebNN: Reject batched MatMul with large K dimension size on OV NPU

2128fae
Select commit
Loading
Failed to load commit list.
Merged

WebNN: Reject batched MatMul with large K dimension size on OV NPU #57011

WebNN: Reject batched MatMul with large K dimension size on OV NPU
2128fae
Select commit
Loading
Failed to load commit list.
Community-TC Integration / wpt-firefox-nightly-stability succeeded Jan 9, 2026 in 15m 23s

Community-TC (pull_request)

Verify that all tests affected by a pull request are stable when executed in firefox.

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2026-01-09T00:13:38.439Z
Resolved: 2026-01-09T00:16:23.836Z
Task Execution Time: 2 minutes, 45 seconds, 397 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log
- public/results/checkrun.md

WPT Command: python3 ./wpt run --channel=nightly --verify --verify-no-chaos-mode --verify-repeat-loop=0 --verify-repeat-restart=10 --github-checks-text-file=/home/test/artifacts/checkrun.md --affected base_head --log-mach-level=info --log-mach=- -y --no-pause --no-restart-on-unexpected --install-fonts --verify-log-full --no-headless --binary=/home/test/build/firefox/firefox firefox

[taskcluster 2026-01-09 00:13:38.532Z] Task ID: H8gZzU8vRMOkYfynCkpnMg
[taskcluster 2026-01-09 00:13:38.532Z] Worker ID: 1659333052795703860
[taskcluster 2026-01-09 00:13:38.532Z] Worker Group: us-east1-b
[taskcluster 2026-01-09 00:13:38.532Z] Worker Node Type: projects/757942385826/machineTypes/n2-standard-4
[taskcluster 2026-01-09 00:13:38.532Z] Worker Pool: proj-wpt/ci
[taskcluster 2026-01-09 00:13:38.532Z] Worker Version: 46.1.0
[taskcluster 2026-01-09 00:13:38.532Z] Public IP: 34.139.86.76
[taskcluster 2026-01-09 00:13:38.532Z] Hostname: proj-wpt-ci-b2uc22nlr3efkncf2br68g

[taskcluster 2026-01-09 00:13:40.340Z] === Task Starting ===
+ '[' '' ']'
+ '[' -d /etc/profile.d ']'
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/01-locale-fix.sh ']'
+ . /etc/profile.d/01-locale-fix.sh
+++ /usr/bin/locale-check C.UTF-8
++ eval
+ for i in /etc/profile.d/*.sh
+ '[' -r /etc/profile.d/apps-bin-path.sh ']'
+ . /etc/profile.d/apps-bin-path.sh

...(2748 lines hidden)...

Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
/webnn/conformance_tests/matmul.https.any.html?gpu
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
/webnn/conformance_tests/matmul.https.any.html?npu
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
  FAIL assert_implements(navigator.ml, 'missing navigator.ml') - assert_implements: missing navigator.ml undefined
webnn_conformance_test/<@https://web-platform.test:8443/webnn/resources/utils.js:1478:33
Test.prototype.step@https://web-platform.test:8443/resources/testharness.js:2869:25
test@https://web-platform.test:8443/resources/testharness.js:633:30
webnn_conformance_test@https://web-platform.test:8443/webnn/resources/utils.js:1478:9
@https://web-platform.test:8443/webnn/conformance_tests/matmul.https.any.js:1141:23
 1:21.54 INFO Got 30 unexpected results, with 0 unexpected passes
 1:21.55 wptserve INFO Stopped http server on 127.0.0.1:8000
 1:21.55 wptserve INFO Stopped http server on 127.0.0.1:8001
 1:21.55 wptserve INFO Stopped http server on 127.0.0.1:8003
 1:21.55 wptserve INFO Stopped http server on 127.0.0.1:8445
 1:21.55 wptserve INFO Stopped http server on 127.0.0.1:8444
 1:21.56 wptserve INFO Stopped http server on 127.0.0.1:8002
 1:21.57 wptserve INFO Stopped http server on 127.0.0.1:8443
 1:21.57 wptserve INFO Stopped http server on 127.0.0.1:9000
 1:21.57 wptserve INFO Stopped http server on 127.0.0.1:8446
 1:21.57 wptserve INFO Stopped WebTransport over HTTP/3 server on 127.0.0.1:11000
 1:21.58 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8888))
 1:21.58 wptserve INFO Close on: (<AddressFamily.AF_INET: 2>, <SocketKind.SOCK_STREAM: 1>, 6, '', ('127.0.0.1', 8889))
 1:21.79 INFO Removed font: Ahem.ttf
 1:21.82 INFO Closing logging queue
 1:21.82 INFO queue closed
 1:21.83 INFO ::: Ran 10 of expected 10 iterations.
 1:21.83 INFO ## All results ##

 1:21.83 INFO ### /webnn/conformance_tests/matmul.https.any.html?cpu ###
 1:21.83 INFO |                          Subtest                          | Results |                       Messages                      |
 1:21.83 INFO |-----------------------------------------------------------|---------|-----------------------------------------------------|
 1:21.83 INFO |                                                           | OK      |                                                     |
 1:21.83 INFO | `assert_implements(navigator.ml, 'missing navigator.ml')` | FAIL    | `assert_implements: missing navigator.ml undefined` |
 1:21.83 INFO 
 1:21.83 INFO ### /webnn/conformance_tests/matmul.https.any.html?gpu ###
 1:21.83 INFO |                          Subtest                          | Results |                       Messages                      |
 1:21.83 INFO |-----------------------------------------------------------|---------|-----------------------------------------------------|
 1:21.83 INFO |                                                           | OK      |                                                     |
 1:21.83 INFO | `assert_implements(navigator.ml, 'missing navigator.ml')` | FAIL    | `assert_implements: missing navigator.ml undefined` |
 1:21.83 INFO 
 1:21.83 INFO ### /webnn/conformance_tests/matmul.https.any.html?npu ###
 1:21.83 INFO |                          Subtest                          | Results |                       Messages                      |
 1:21.83 INFO |-----------------------------------------------------------|---------|-----------------------------------------------------|
 1:21.83 INFO |                                                           | OK      |                                                     |
 1:21.83 INFO | `assert_implements(navigator.ml, 'missing navigator.ml')` | FAIL    | `assert_implements: missing navigator.ml undefined` |
 1:21.83 INFO 
 1:21.83 INFO ::: Running tests in a loop with restarts 10 times : PASS
 1:21.83 INFO :::
 1:21.83 INFO ::: Test verification PASS
 1:21.83 INFO :::
[taskcluster 2026-01-09 00:16:21.721Z] === Task Finished ===
[taskcluster 2026-01-09 00:16:22.144Z] Successful task run with exit code: 0 completed in 163.613 seconds
View more details on Community-TC Integration