Action to run conformance test (#176)

* Conformance action

* Compile files for conformance test

* Fix Python version

* Run the tests

* Format code

* Add failing tests list

* Format proto files

* Fix lint

* Format code

* Add back full CI

* Run conformance tests with all Python versions on MacOS and Ubuntu

* Pin conformance test version

Author: AdrienVannson

.github/workflows/ci.yml

@@ -160,3 +160,29 @@ jobs:
         working-directory: ./betterproto2
         shell: bash
         run: uv run poe test
+
+      # Run conformance test on all Ubuntu and MacOS versions
+      - name: Install Node.js
+        if: matrix.os == 'Ubuntu' || matrix.os == 'MacOS'
+        uses: actions/setup-node@v6
+        with:
+          node-version: 24
+
+      - name: Install conformance runner
+        if: matrix.os == 'Ubuntu' || matrix.os == 'MacOS'
+        run: npm install -g [email protected]
+
+      - name: Create test script
+        if: matrix.os == 'Ubuntu' || matrix.os == 'MacOS'
+        shell: bash
+        working-directory: ./betterproto2
+        run: |
+          echo '#!/bin/bash' > script.sh
+          echo 'python -m tests.conformance.main' >> script.sh
+          chmod +x script.sh
+
+      - name: Run conformance tests
+        if: matrix.os == 'Ubuntu' || matrix.os == 'MacOS'
+        working-directory: ./betterproto2
+        run: |
+          uv run conformance_test_runner --failure_list tests/conformance/failing_tests.txt ./script.sh