add opset-14, move ci pipeline to test opset-8 -> opset-14 (#1583)

* add opset-14, move ci pipeline to test opset-8 -> opset-14

Signed-off-by: Guenther Schmuelling <[email protected]>

* pylint

Signed-off-by: Guenther Schmuelling <[email protected]>

Author: guschmue

README.md

@@ -16,10 +16,10 @@ The common issues we run into we try to document here [Troubleshooting Guide](Tr
 
 <br/>
 
-| Build Type | OS | Python | Tensorflow | Onnx opset | Status |
+| Build Type | OS | Python | Tensorflow | ONNX opset | Status |
 | ---        | ---    | ---    | ---        | ---        | ---    |
-| Unit Test - Basic | Linux, MacOS<sup>\*</sup>, Windows<sup>\*</sup> | 3.6, 3.7, 3.8 | 1.12-1.15, 2.1-2.5 | 7-13 | [![Build Status](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_apis/build/status/unit_test?branchName=master)](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_build/latest?definitionId=16&branchName=master) |
-| Unit Test - Full | Linux, MacOS, Windows | 3.6, 3.7, 3.8 | 1.12-1.15, 2.1-2.5 | 7-13 | [![Build Status](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_apis/build/status/unit_test-matrix?branchName=master)](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_build/latest?definitionId=18&branchName=master) | |
+| Unit Test - Basic | Linux, MacOS<sup>\*</sup>, Windows<sup>\*</sup> | 3.6-3.9 | 1.12-1.15, 2.1-2.5 | 8-15 | [![Build Status](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_apis/build/status/unit_test?branchName=master)](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_build/latest?definitionId=16&branchName=master) |
+| Unit Test - Full | Linux, MacOS, Windows | 3.6-3.9 | 1.12-1.15, 2.1-2.5 | 8-14 | [![Build Status](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_apis/build/status/unit_test-matrix?branchName=master)](https://dev.azure.com/tensorflow-onnx/tensorflow-onnx/_build/latest?definitionId=18&branchName=master) | |
 <br/>
 
 ## Supported Versions
@@ -28,21 +28,23 @@ The common issues we run into we try to document here [Troubleshooting Guide](Tr
 
 tf2onnx will use the ONNX version installed on your system and installs the latest ONNX version if none is found.
 
-We support ONNX opset-6 to opset-13. By default we use ```opset-9``` for the resulting ONNX graph since most runtimes will support opset-9.
+We support and test ONNX opset-8 to opset-14. opset-6 and opset-7 should work but we don't test them.
+By default we use ```opset-9``` for the resulting ONNX graph since most runtimes will support opset-9.
 
 If you want the graph to be generated with a specific opset, use ```--opset``` in the command line, for example ```--opset 13```.
 
 ### TensorFlow
 
-We support ```tf-1.x graphs``` and ```tf-2```. To keep our test matrix manageable we test tf2onnx running on top of ```tf-1.12 and up```.
+We support ```tf-1.x graphs``` and ```tf-2```. To keep our test matrix manageable we test tf2onnx running on top of ```tf-1.12 or better```.
 
 When running under tf-2.x tf2onnx will use the tensorflow V2 controlflow.
 
 You can install tf2onnx on top of tf-1.x or tf-2.x.
 
 ### Python
 
-We support Python ```3.6```, ```3.7``` and ```3.8```.
+We support Python ```3.6-3.9```.
+Note that on windows for Python > 3.7 the protobuf package doesn't use the cpp implementation and is very slow - we recommend to use Python 3.7 for that reason.
 
 ## Prerequisites
 

ci_build/azure_pipelines/pretrained_model_test-matrix.yml

@@ -32,7 +32,7 @@ jobs:
   parameters:
     platforms: ['linux', 'windows']
     python_versions: ['3.8']
-    tf_versions: ['2.5.0rc1']
+    tf_versions: ['2.5.0']
     job:
       steps:
       - template: 'pretrained_model_test.yml'

ci_build/azure_pipelines/templates/job_generator.yml

@@ -5,7 +5,7 @@ parameters:
   python_versions: ['3.7']
   tf_versions: ['']
   onnx_versions: ['']
-  onnx_opsets: ['13', '12', '11', '10', '9', '8', '7']
+  onnx_opsets: ['14', '13', '12', '11', '10', '9', '8']
   onnx_backends: {onnxruntime: ['1.8.0']}
   job: {}
   run_setup: 'True'

ci_build/azure_pipelines/templates/unit_test.yml

@@ -1,7 +1,7 @@
 # Run unit test
 
 parameters:
-    onnx_opsets: ['13', '12', '11', '10', '9', '8', '7']
+    onnx_opsets: ['14', '13', '12', '11', '10', '9', '8']
     skip_tflite_tests: 'True'
     skip_tf_tests: 'False'
 

ci_build/azure_pipelines/unit_test-matrix.yml

@@ -40,7 +40,7 @@ stages:
       parameters:
         platforms: ['linux', 'windows']
         python_versions: ['3.8']
-        tf_versions: ['2.5.0rc1']
+        tf_versions: ['2.5.0']
         onnx_opsets: ['']
         job:
           steps:

ci_build/azure_pipelines/unit_test.yml

@@ -6,7 +6,7 @@ stages:
     - template: 'templates/job_generator.yml'
       parameters:
         python_versions: ['3.8']
-        tf_versions: ['2.5.0rc1']
+        tf_versions: ['2.5.0']
         onnx_opsets: ['']
         skip_tflite_tests: 'False'
         skip_tf_tests: 'True'
@@ -30,7 +30,7 @@ stages:
     - template: 'templates/job_generator.yml'
       parameters:
         python_versions: ['3.8']
-        tf_versions: ['2.5.0rc1']
+        tf_versions: ['2.5.0']
         onnx_opsets: ['']
         job:
           steps:

tf2onnx/constants.py

@@ -47,5 +47,5 @@
 # Mapping opset to IR version.
 # Note: opset 7 and opset 8 came out with IR3 but we need IR4 because of PlaceholderWithDefault
 OPSET_TO_IR_VERSION = {
-    1: 3, 2: 3, 3: 3, 4: 3, 5: 3, 6: 3, 7: 4, 8: 4, 9: 4, 10: 5, 11: 6, 12: 7, 13: 7
+    1: 3, 2: 3, 3: 3, 4: 3, 5: 3, 6: 3, 7: 4, 8: 4, 9: 4, 10: 5, 11: 6, 12: 7, 13: 7, 14: 7
 }