Merge pull request #555 from NVIDIA/release_procedure_updates

Update RELEASE_CHECKLIST.md

Author: narendasan

docsrc/RELEASE_CHECKLIST.md

@@ -21,7 +21,7 @@ will result in a minor version bump and sigificant bug fixes will result in a pa
     - All checked in applications (cpp and python) should compile and work
 3. Generate new index of converters and evalutators
     - `bazel run //tools/supportedops -- <PATH TO TRTORCH>/docsrc/indices/supported_ops.rst`
-3. Version bump PR
+4. Version bump PR
     - There should be a PR which will be the PR that bumps the actual version of the library, this PR should contain the following
         - Bump version in `py/setup.py`
         - Make sure dependency versions are updated in `py/requirements.txt`, `tests/py/requirements.txt` and `py/setup.py`
@@ -34,7 +34,29 @@ will result in a minor version bump and sigificant bug fixes will result in a pa
             - `make html`
         - Generate changelog
             - `conventional-changelog -p angular -s -i CHANGELOG.md -t <last version tag> -a`
-4. Once PR is merged tag commit and start creating release on GitHub
+
+5. Run performance tests:
+    - Models: 
+        - Torchbench BERT
+            - `[2, 128], [2, 128]` 
+        - EfficientNet B0
+            - `[3, 224, 224]`
+            - `[3, 1920, 1080]` (P2)  
+        - ViT
+            - `[3, 224, 224]` 
+            - `[3, 1920, 1080]` (P2)   
+        - ResNet50 (v1.5 ?)
+            - `[3, 224, 224]`
+            - `[3, 1920, 1080]` (P2)    
+    - Batch Sizes: 1, 4, 8, 16, 32
+    - Frameworks: PyTorch, TRTorch, ONNX + TRT
+        - If any models do not convert to ONNX / TRT, that is fine. Mark them as failling / no result
+    - Devices: 
+        - A100 (P0)
+        - T4 is a nice to have (P2) (Add batch sizes 64, 128, 256, 512, 1024 if so)
+        - Jetson also nice to have (P4) 
+
+6. Once PR is merged tag commit and start creating release on GitHub
     - Paste in Milestone information and Changelog information into release notes
     - Generate libtrtorch.tar.gz for the following platforms:
         - x86_64 cxx11-abi
@@ -43,4 +65,4 @@ will result in a minor version bump and sigificant bug fixes will result in a pa
     - Generate Python packages for Python 3.6/3.7/3.8/3.9 for x86_64
         - TODO: Build a manylinux container for aarch64
         - `docker run -it -v$(pwd)/..:/workspace/TRTorch build_trtorch_wheel /bin/bash /workspace/TRTorch/py/build_whl.sh` generates all wheels
-            - To build container `docker build -t build_trtorch_wheel .`
+            - To build container `docker build -t build_trtorch_wheel .`