Skip to content

Commit 25c6d92

Browse files
committed
Update README
1 parent b45355f commit 25c6d92

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

README.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -75,11 +75,12 @@ Referring to the [ImageNet 1000 class labels](https://gist.github.com/yrevar/942
7575
Based on a simple benchmark of 100000 iterations of SqueezeNet inference, the run time is on par (within 3% of) ONNX Runtime (via Python).
7676
The discrepancy can be accounted for by the overhead of shipping data between the JVM and native memory.
7777

78-
When using this API, we load the provided ONNX model file and pass it as-is to the underlying ONNX backend.
78+
When using this API, we load the provided ONNX model file and pass it as-is to the underlying ONNX backend, which is able to optimize the full graph.
7979
This is the most performant execution mode, and is recommended for off-the-shelf models / performance-critical scenarios.
8080

81-
This full-model API is untyped in the inputs, so it can fail at runtime. This inevitable because we load models from disk at runtime.
82-
Feel free to wrap your calls into it in a facade with typed inputs.
81+
This full-model API is untyped in the inputs, so it can fail at runtime. This is inevitable because we load models from disk at runtime.
82+
An upside of this is that you are free to use dynamic shapes, for example in the case of differing batch sizes per model call (assuming your model supports this via symbolic dimensions, see [ONNX Shape Inference](https://github.com/onnx/onnx/blob/main/docs/ShapeInference.md) ).
83+
If your input shapes are static, feel free to wrap your calls into it in a facade with typed inputs.
8384

8485
## Project Details
8586

@@ -119,6 +120,7 @@ Supported ONNX input and output tensor data types:
119120
* Float
120121
* Double
121122
* Boolean
123+
* String
122124

123125
Supported ONNX ops:
124126
* ONNX-Scala, Fine-grained API: 87/178 total

0 commit comments

Comments
 (0)