Fix CI (Azure#39043)

* nothing change

* remove version pin

* try changing pf requirements to repo

* try again

* fix setup syntax

* try another format

* try again

* try again, again

* undo stuff

* undo whitespace

* remove pf_service_isolation

* undo setup change

* pin pf to current

* upate package to use python 3.9 at least

* get the changes ready. when they confirm which CI I'll submit the PR

* move necessary requirements

---------

Co-authored-by: Scott Beddall <[email protected]>

Author: MilesHolland

sdk/evaluation/azure-ai-evaluation/CHANGELOG.md

@@ -12,6 +12,7 @@
 - Fixed the non adversarial simulator to run in task-free mode
 
 ### Other Changes
+- Changed minimum required python version to use this package from 3.8 to 3.9
 - Stop dependency on the local promptflow service. No promptflow service will automatically start when running evaluation.
 
 ## 1.1.0 (2024-12-12)

sdk/evaluation/azure-ai-evaluation/README.md

@@ -22,7 +22,7 @@ Azure AI SDK provides following to evaluate Generative AI Applications:
 
 ### Prerequisites
 
-- Python 3.8 or later is required to use this package.
+- Python 3.9 or later is required to use this package.
 - [Optional] You must have [Azure AI Project][ai_project] or [Azure Open AI][azure_openai] to use AI-assisted evaluators
 
 ### Install the package

sdk/evaluation/azure-ai-evaluation/samples/README.md

@@ -31,7 +31,7 @@ Each samples file is run during the azure-sdk-for-python Build CI to ensure that
 
 ## Prerequisites
 
-* Python 3.8, 3.9, 3.10, 3.11, or 3.12 is required to use this package
+* Python 3.9, 3.10, 3.11, or 3.12 is required to use this package
 * You must have an [Azure subscription](https://azure.microsoft.com/free/) to run these samples.
 * You must have an Azure AI project and a model deployment.
 

sdk/evaluation/azure-ai-evaluation/setup.py

@@ -46,7 +46,6 @@
         "Programming Language :: Python",
         "Programming Language :: Python :: 3",
         "Programming Language :: Python :: 3 :: Only",
-        "Programming Language :: Python :: 3.8",
         "Programming Language :: Python :: 3.9",
         "Programming Language :: Python :: 3.10",
         "Programming Language :: Python :: 3.11",
@@ -63,10 +62,10 @@
             "azure.ai",
         ]
     ),
-    python_requires=">=3.8",
+    python_requires=">=3.9",
     install_requires=[
-        "promptflow-devkit>=1.15.0",
-        "promptflow-core>=1.15.0",
+        "promptflow-devkit>=1.17.1",
+        "promptflow-core>=1.17.1",
         "pyjwt>=2.8.0",
         # pickle support for credentials was added to this release
         "azure-identity>=1.16.0",

sdk/evaluation/azure-ai-evaluation/tests/__pf_service_isolation.py

@@ -1,5 +1,4 @@
 from .__openai_patcher import TestProxyConfig, TestProxyHttpxClientBase  # isort: split
-from . import __pf_service_isolation  # isort: split  # noqa: F401
 
 import os
 import json

sdk/evaluation/azure-ai-evaluation/tests/conftest.py

@@ -29,13 +29,13 @@ extends:
     TestProxy: true
     # This custom matrix config should be dropped once:
     #  * Once azure-ai-ml supports 3.13 (currently crashes due to type annotation)
-    MatrixConfigs: 
+    MatrixConfigs:
       - Name: ai_ci_matrix
         Path: sdk/evaluation/platform-matrix.json
         Selection: sparse
         GenerateVMJobs: true
     MatrixFilters:
-      - PythonVersion=^(?!3\.13)
+      - PythonVersion=^(?!(3\.13|3\.8))
     Artifacts:
     - name: azure-ai-evaluation
       safeName: azureaievaluation

sdk/evaluation/ci.yml

@@ -9,7 +9,7 @@
       "macos-latest": { "OSVmImage": "env:MACVMIMAGE", "Pool": "env:MACPOOL" },	
       "ubuntu-20.04": { "OSVmImage": "env:LINUXVMIMAGE", "Pool": "env:LINUXPOOL" }	
     },	
-    "PythonVersion": [ "3.8", "3.11", "3.10" ],	
+    "PythonVersion": [ "3.9", "3.11", "3.10" ],	
     "CoverageArg": "--disablecov",	
     "TestSamples": "false"	
   },	

sdk/evaluation/platform-matrix.json

@@ -43,7 +43,7 @@
 
 TEST_COMPATIBILITY_MAP = {
     "azure-ai-ml": ">=3.7, !=3.13.*",
-    "azure-ai-evaluation": ">=3.7, !=3.13.*"
+    "azure-ai-evaluation": ">=3.9, !=3.13.*"
 }
 TEST_PYTHON_DISTRO_INCOMPATIBILITY_MAP = {
     "azure-storage-blob": "pypy",