Skip to content

Conversation

@adrianlizarraga
Copy link
Contributor

@adrianlizarraga adrianlizarraga commented Nov 19, 2025

Description

  • Updates the ep_weight_sharing_ctx_gen tool to support specifying a plugin EP configuration (via JSON).
  • Mark the ep_weight_sharing_ctx_gen tool as deprecated and add notification to README that recommends the use the public Python ORT APIs instead.
  • Added an example Python script in the README.
  • Added a Python unit test that tests compiling models with weight sharing using an example plugin EP.

Tool usage

Create a JSON file that contains information about the plugin EP to load/use (e.g., example_plugin_ep_config.json):

{
    "ep_library_registration_name": "example_plugin_ep",
    "ep_library_path": "example_plugin_ep.dll",
    "selected_ep_name": "example_plugin_ep",
    "default_ep_options": { "option_key": "option_value" }
}

Call the ep_weight_sharing_ctx_gen tool with the -p command-line option to specify the location of the above configuration file:

$ ep_weight_sharing_ctx_gen.exe -p example_plugin_ep_config.json model_1.onnx,model_2.onnx

Motivation and Context

Close the functionality gap between traditional provider-bridge EPs and plugin EPs. This PR allows using plugin EPs with the tool that compiles models with weight sharing.

edgchen1
edgchen1 previously approved these changes Nov 22, 2025
edgchen1
edgchen1 previously approved these changes Nov 24, 2025
@adrianlizarraga adrianlizarraga merged commit 8e951ef into main Nov 25, 2025
89 of 91 checks passed
@adrianlizarraga adrianlizarraga deleted the adrianl/EpWeightSharingTool_SupportPluginEps branch November 25, 2025 00:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants