Skip to content

Commit 052a46a

Browse files
aprilk-msCopilot
andauthored
Remove azure_ai_project parameter from all builtin evaluator specs (#4896)
Remove the azure_ai_project init parameter from 11 service-based evaluators under assets/evaluators/builtin/. This parameter is no longer needed. Affected evaluators: - groundedness_pro - hate_unfairness - violence - self_harm - sexual - sensitive_data_leakage - prohibited_actions - indirect_attack - code_vulnerability - ungrounded_attributes - protected_material Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent a9ed4fe commit 052a46a

File tree

11 files changed

+15
-37
lines changed

11 files changed

+15
-37
lines changed

assets/evaluators/builtin/code_vulnerability/spec.yaml

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -12,10 +12,8 @@ tags:
1212
is_red_team_scenario: "true"
1313
initParameterSchema:
1414
type: "object"
15-
properties:
16-
azure_ai_project:
17-
type: "string"
18-
required: ["azure_ai_project"]
15+
properties: {}
16+
required: []
1917
dataMappingSchema:
2018
type: "object"
2119
properties:

assets/evaluators/builtin/groundedness_pro/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,14 +11,12 @@ tags:
1111
initParameterSchema:
1212
type: "object"
1313
properties:
14-
azure_ai_project:
15-
type: "string"
1614
threshold:
1715
type: "number"
1816
minimum: 1
1917
maximum: 5
2018
multipleOf: 1
21-
required: ["azure_ai_project"]
19+
required: []
2220
dataMappingSchema:
2321
type: "object"
2422
properties:

assets/evaluators/builtin/hate_unfairness/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,14 +15,12 @@ tags:
1515
initParameterSchema:
1616
type: "object"
1717
properties:
18-
azure_ai_project:
19-
type: "string"
2018
threshold:
2119
type: "number"
2220
minimum: 0
2321
maximum: 7
2422
multipleOf: 1
25-
required: ["azure_ai_project"]
23+
required: []
2624
dataMappingSchema:
2725
type: "object"
2826
properties:

assets/evaluators/builtin/indirect_attack/spec.yaml

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -10,10 +10,8 @@ tags:
1010
provider: "Microsoft"
1111
initParameterSchema:
1212
type: "object"
13-
properties:
14-
azure_ai_project:
15-
type: "string"
16-
required: ["azure_ai_project"]
13+
properties: {}
14+
required: []
1715
dataMappingSchema:
1816
type: "object"
1917
properties:

assets/evaluators/builtin/prohibited_actions/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,14 +15,12 @@ tags:
1515
initParameterSchema:
1616
type: "object"
1717
properties:
18-
azure_ai_project:
19-
type: "string"
2018
threshold:
2119
type: "number"
2220
minimum: 0
2321
maximum: 5
2422
multipleOf: 1
25-
required: ["azure_ai_project"]
23+
required: []
2624
dataMappingSchema:
2725
type: "object"
2826
properties:

assets/evaluators/builtin/protected_material/spec.yaml

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -10,10 +10,8 @@ tags:
1010
provider: "Microsoft"
1111
initParameterSchema:
1212
type: "object"
13-
properties:
14-
azure_ai_project:
15-
type: "string"
16-
required: ["azure_ai_project"]
13+
properties: {}
14+
required: []
1715
dataMappingSchema:
1816
type: "object"
1917
properties:

assets/evaluators/builtin/self_harm/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,14 +15,12 @@ tags:
1515
initParameterSchema:
1616
type: "object"
1717
properties:
18-
azure_ai_project:
19-
type: "string"
2018
threshold:
2119
type: "number"
2220
minimum: 0
2321
maximum: 7
2422
multipleOf: 1
25-
required: ["azure_ai_project"]
23+
required: []
2624
dataMappingSchema:
2725
type: "object"
2826
properties:

assets/evaluators/builtin/sensitive_data_leakage/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,14 +15,12 @@ tags:
1515
initParameterSchema:
1616
type: "object"
1717
properties:
18-
azure_ai_project:
19-
type: "string"
2018
threshold:
2119
type: "number"
2220
minimum: 0
2321
maximum: 5
2422
multipleOf: 1
25-
required: ["azure_ai_project"]
23+
required: []
2624
dataMappingSchema:
2725
type: "object"
2826
properties:

assets/evaluators/builtin/sexual/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -15,14 +15,12 @@ tags:
1515
initParameterSchema:
1616
type: "object"
1717
properties:
18-
azure_ai_project:
19-
type: "string"
2018
threshold:
2119
type: "number"
2220
minimum: 0
2321
maximum: 7
2422
multipleOf: 1
25-
required: ["azure_ai_project"]
23+
required: []
2624
dataMappingSchema:
2725
type: "object"
2826
properties:

assets/evaluators/builtin/ungrounded_attributes/spec.yaml

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -12,10 +12,8 @@ tags:
1212
is_red_team_scenario: "true"
1313
initParameterSchema:
1414
type: "object"
15-
properties:
16-
azure_ai_project:
17-
type: "string"
18-
required: ["azure_ai_project"]
15+
properties: {}
16+
required: []
1917
dataMappingSchema:
2018
type: "object"
2119
properties:

0 commit comments

Comments
 (0)