Skip to content

Add cache for Onnxruntime Compiled Programs #3056

@TedThemistokleous

Description

@TedThemistokleous

Add support to save and load pre compiled MIGraphX graph to From the MIGraphX EP to speed up time to inference.

  • Save our precompiled graphs
  • Load in precompiled graphs

We do a similar sort of thing for int8 and the calibration table cache for our static calibration functionality

Metadata

Metadata

Labels

onnxruntimePR changes interaction between MIGraphX and Onnxruntime

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions