File tree Expand file tree Collapse file tree 1 file changed +16
-0
lines changed
Expand file tree Collapse file tree 1 file changed +16
-0
lines changed Original file line number Diff line number Diff line change @@ -100,3 +100,19 @@ Let's export with ONNX this time and checks for discrepancies.
100100
101101 main("validate -m arnir0/Tiny-LLM --run -v 1 --export onnx-dynamo -o dump_models --patch --opt ir".split())
102102
103+ Run onnxruntime fusions
104+ +++++++++++++++++++++++
105+
106+ This option runs `transformers optimizations <https://onnxruntime.ai/docs/performance/transformers-optimization.html >`_
107+ implemented in :epkg: `onnxruntime `. The list of supported ``model_type `` can be found in the documentation
108+ of function :func: `onnx_diagnostic.torch_models.test_helper.run_ort_fusion `.
109+
110+ .. code-block ::
111+
112+ python -m onnx_diagnostic validate -m arnir0/Tiny-LLM --run -v 1 --export onnx-dynamo -o dump_models --patch --opt ir --ortfusiontype ALL
113+
114+ .. runpython ::
115+
116+ from onnx_diagnostic._command_lines_parser import main
117+
118+ main("validate -m arnir0/Tiny-LLM --run -v 1 --export onnx-dynamo -o dump_models --patch --opt ir --ortfusiontype ALL".split())
You can’t perform that action at this time.
0 commit comments