[SPARK-52077][PYTHON][CONNECT][TEST] Skip ArrowUDTFParityTests in Spark Connect compatibility test

This PR proposes to skip ArrowUDTFParityTests in Spark Connect compatibility test for now.

After apache#50099, the compatibility test fails https://github.com/apache/spark/actions/runs/14959668798/job/42019945629

In fact, UDTF with Arrow is still under development so we can skip the tests for now

No, test-only.

Will monitor the build.

No.

Closes apache#50856 from HyukjinKwon/SPARK-44856-followup.

Authored-by: Hyukjin Kwon <gurwls223@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit 9bb0409)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>

Author: HyukjinKwon

python/pyspark/sql/tests/connect/test_parity_udtf.py

@@ -14,6 +14,7 @@
 # See the License for the specific language governing permissions and
 # limitations under the License.
 #
+import os
 import unittest
 
 from pyspark.testing.connectutils import should_test_connect
@@ -88,6 +89,10 @@ def _add_file(self, path):
         self.spark.addArtifacts(path, file=True)
 
 
+@unittest.skipIf(
+    os.environ.get("SPARK_SKIP_CONNECT_COMPAT_TESTS") == "1",
+    "Python UDTF with Arrow is still under development.",
+)
 class ArrowUDTFParityTests(UDTFArrowTestsMixin, UDTFParityTests):
     @classmethod
     def setUpClass(cls):