[WIP] Make WebGPU EP compatible with EP API by fs-eire · Pull Request #26907 · microsoft/onnxruntime

fs-eire · 2026-01-05T09:27:07Z

Description

This PR makes it possible to build WebGPU EP as an EP API based plugin EP.

Requirements

The goal of this PR is to support both building WebGPU EP as a bundled EP and an EP API based plugin EP. This approach allows:

enabling WebGPU EP as a standalone plugin EP package for WCR usage
graceful transition for WebGPU EP as an native EP for language binding, from the bundled EP to an EP API based plugin EP
keep the existing usage (static library) working (majorly for web)

Design & Implementation

Instead of changing WebGPU EP from a bundled EP to an EP API based plugin EP in one shot, this PR extend WebGPU EP to support building as plugin EP.

add a new folder include/onnxruntime/ep with a bunches of header files. Those files are not WebGPU specific. They are used for:
- include common defines/functions/macros for plugin EP to use
- include a few "adapter" classes that takes C-API objects to simulate ORT internal classes behaviors
- include a few "override" classes that simulate ORT internal classes, but using implementations that only depend on C-API
- include a special base class onnxruntime::ep::Ep to inherit from
These header files allow a compile time "switch" to the different set of types to minimize changes to existing code. Specifically, pch.h is required to be included as PCH to make sure the "override" to take place correctly.
add a new folder onnxruntime/core/providers/webgpu/ep for EP API implementation, specifically:
- api.cc: implements CreateEpFactories and ReleaseEpFactory
- ep.cc ep.h: implement class onnxruntime::webgpu::ep::Ep
- factory.cc factory.h: implement class onnxruntime::webgpu::ep::Factory

Dependencies and Prerequisites

(unmerged changes are included as a part of current PR)

Missing Parts

Allow setting Global/Default EP options

Copilot

Pull request overview

This PR extends WebGPU EP to support building as both a bundled EP (static library) and an EP API-based plugin EP (shared library). The changes introduce a new adapter infrastructure in include/onnxruntime/ep/ that bridges C-API objects to simulate ORT internal class behaviors, enabling compile-time switching between build modes with minimal code changes.

Key changes:

New EP adapter infrastructure with header-only wrapper classes for kernel info, context, registry, and EP interface
WebGPU EP API implementation (api.cc, factory.cc/h, ep.cc/h) in onnxruntime/core/providers/webgpu/ep/
Templated CPU tensor operator base classes to work with both native and adapter OpKernelInfo types
Enhanced C API with KernelInfo_GetOperatorType, KernelInfo_GetSinceVersion, and KernelInfo_GetEp
Test infrastructure updates including example kernel registry changes (Mul kernel renamed to BinaryOp supporting both Add and Mul)

Reviewed changes

Copilot reviewed 75 out of 75 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
include/onnxruntime/ep/*.h	New EP adapter infrastructure headers providing C-API wrappers for kernel registration and execution
onnxruntime/core/providers/webgpu/ep/*	WebGPU EP API implementation for factory, EP instance, and plugin entry points
onnxruntime/core/providers/cpu/tensor/*.h	Templated base classes for tensor ops to support both native and adapter kernel info types
onnxruntime/test/autoep/*	Test updates including BinaryOp generalization and additional test coverage
onnxruntime/core/session/*.cc	Core API additions for kernel info operator type, version, and EP retrieval

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

onnxruntime/core/providers/webgpu/tensor/upsample.cc

Copilot · 2026-01-06T08:12:57Z

onnxruntime/core/providers/cpu/tensor/upsamplebase.h

+      if constexpr (std::is_same_v<KernelInfoType, onnxruntime::OpKernelInfo>) {
+        auto x_shape = node.InputDefs()[0]->Shape();
+        if (x_shape != nullptr) {
+          rank = x_shape->dim_size();
+        }
+      } else {
+        int is_const;
+        auto tensor = info.GetKernelInfo().GetTensorConstantInput(0, &is_const);
+        if (is_const) {
+          auto type_and_shape_info = tensor.GetTensorTypeAndShapeInfo();
+          if (type_and_shape_info.HasShape()) {
+            rank = static_cast<int64_t>(type_and_shape_info.GetShape().size());
+          }
+        }
+      }


The constexpr branch at line 223 checks for std::is_same_v<KernelInfoType, onnxruntime::OpKernelInfo> but at line 229, it tries to call methods on info.GetKernelInfo() which suggests that info is expected to be of type onnxruntime::ep::adapter::OpKernelInfo. However, if that's the case, the else branch would execute, and info.GetKernelInfo() would return an Ort::ConstKernelInfo, not an object with a GetTensorConstantInput method. This logic appears inconsistent and may cause compilation or runtime errors.

include/onnxruntime/ep/adapter/tensor_helper.h

onnxruntime/core/providers/webgpu/ep/factory.cc

onnxruntime/core/providers/webgpu/webgpu_provider_factory.cc

### Description This PR adds a few headers for supporting building WebGPU EP and CUDA EP as plugin EPs. See summary of #26907

fs-eire force-pushed the ep-api branch 2 times, most recently from 1ca0d32 to 6873ade Compare January 6, 2026 08:01

fs-eire requested a review from Copilot January 6, 2026 08:09

Copilot started reviewing on behalf of fs-eire January 6, 2026 08:09 View session

fs-eire mentioned this pull request Jan 6, 2026

[EP API] header-only adapter for EP API #26919

Merged

Copilot AI reviewed Jan 6, 2026

View reviewed changes

fs-eire force-pushed the ep-api branch 6 times, most recently from 4d451dc to e52d706 Compare January 22, 2026 01:27

fs-eire force-pushed the ep-api branch 6 times, most recently from 9e3419b to 0e58206 Compare February 2, 2026 22:33

fs-eire force-pushed the ep-api branch 5 times, most recently from 4a5e066 to 6333b00 Compare February 7, 2026 05:50

fs-eire force-pushed the ep-api branch from 6333b00 to 1967706 Compare February 26, 2026 07:43

fs-eire added a commit that referenced this pull request Feb 28, 2026

[EP API] header-only adapter for EP API (#26919)

4fd9ebb

### Description This PR adds a few headers for supporting building WebGPU EP and CUDA EP as plugin EPs. See summary of #26907

fs-eire force-pushed the ep-api branch 4 times, most recently from e5caa04 to a12a6a9 Compare March 6, 2026 01:56

fs-eire force-pushed the ep-api branch from a12a6a9 to e4edceb Compare March 8, 2026 00:16

fs-eire added 8 commits March 7, 2026 17:20

Fix WebGPU EP crash on exit

d7a6c81

[EP Plugin Adapter] support LoggingManager::HasDefaultLogger()

90dce51

Implement EP API for WebGPU EP

5b6a7ae

integrate with adapters change of LoggingManager

adb6eff

fix build break

e0b1db1

add pipeline job for plugin EP build

3344970

build fix

225237b

update yml

2365a52

fs-eire force-pushed the ep-api branch from e4edceb to 2365a52 Compare March 8, 2026 03:25

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[WIP] Make WebGPU EP compatible with EP API#26907

[WIP] Make WebGPU EP compatible with EP API#26907
fs-eire wants to merge 8 commits intomicrosoft:mainfrom
fs-eire:ep-api

fs-eire commented Jan 5, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Copilot AI Jan 6, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

fs-eire commented Jan 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Requirements

Design & Implementation

Dependencies and Prerequisites

Missing Parts

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Copilot AI Jan 6, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

fs-eire commented Jan 5, 2026 •

edited

Loading