ci: disable tests on aarch64-unknown-linux-gnu

Can't seem to get them to run, so, boo, no more testing on this
platform. Weird how it builds, but it won't build the tests in the same
exact fashion.

Author: Xevion

.github/workflows/test.yaml

@@ -20,7 +20,7 @@ jobs:
             cross: false
           - os: ubuntu-latest
             target: aarch64-unknown-linux-gnu
-            test: true
+            test: false
             cross: true
           - os: macos-latest
             target: x86_64-apple-darwin