Skip to content

Commit 1ba066d

Browse files
fix: remove Designer tags from benchmark datasets (#4899)
Remove azureml.Designer tags from benchmark datasets to prevent them from appearing in Azure ML Designer UI. These are benchmark-only datasets not intended for general Designer use. Updated datasets: - gpqa_diamond: v1 → v2 - musr: v1 → v2 - truthfulqa: v2 → v3 - frontierscience: v1 → v2 - bigbenchhard: v1 → v2 Updated benchmarkspecs to reference new dataset versions. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent 1994dbe commit 1ba066d

File tree

15 files changed

+15
-25
lines changed

15 files changed

+15
-25
lines changed

assets/benchmarkspecs/builtin/bigbenchhard/spec.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ dataset:
3939
dataset_source: "https://github.com/suzgunmirac/BIG-Bench-Hard"
4040
source:
4141
provider: "mlregistry"
42-
sourceDatasetId: "azureml://registries/azureml/data/bigbenchhard/versions/1"
42+
sourceDatasetId: "azureml://registries/azureml/data/bigbenchhard/versions/2"
4343
sourceFormat: "jsonl"
4444
properties:
4545
file_name: "bbh_samples_flat.jsonl"

assets/benchmarkspecs/builtin/frontierscience/spec.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ dataset:
3838
dataset_source: "https://huggingface.co/datasets/openai/frontierscience"
3939
source:
4040
provider: "mlregistry"
41-
sourceDatasetId: "azureml://registries/azureml/data/frontierscience/versions/1"
41+
sourceDatasetId: "azureml://registries/azureml/data/frontierscience/versions/2"
4242
sourceFormat: "csv"
4343
properties:
4444
file_name: "frontierscience.csv"

assets/benchmarkspecs/builtin/gpqa_diamond/spec.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ dataset:
3838
dataset_source: "https://github.com/idavidrein/gpqa"
3939
source:
4040
provider: "mlregistry"
41-
sourceDatasetId: "azureml://registries/azureml/data/gpqa_diamond/versions/1"
41+
sourceDatasetId: "azureml://registries/azureml/data/gpqa_diamond/versions/2"
4242
sourceFormat: "csv"
4343
properties:
4444
file_name: "gpqa_diamond.csv"

assets/benchmarkspecs/builtin/musr/spec.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ dataset:
3838
dataset_source: "https://huggingface.co/datasets/TAUR-Lab/MuSR"
3939
source:
4040
provider: "mlregistry"
41-
sourceDatasetId: "azureml://registries/azureml/data/musr/versions/1"
41+
sourceDatasetId: "azureml://registries/azureml/data/musr/versions/2"
4242
sourceFormat: "csv"
4343
properties:
4444
file_name: "MuSR_all.csv"

assets/benchmarkspecs/builtin/truthful_qa/spec.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ dataset:
3333
dataset_source: "https://github.com/sylinrl/TruthfulQA/"
3434
source:
3535
provider: "mlregistry"
36-
sourceDatasetId: "azureml://registries/azureml/data/truthful_qa/versions/2"
36+
sourceDatasetId: "azureml://registries/azureml/data/truthful_qa/versions/3"
3737
sourceFormat: "csv"
3838
properties:
3939
file_name: "TruthfulQA.csv"

assets/pipelines/data/global_dataset/generic_csv/bigbenchhard/asset.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
name: bigbenchhard
2-
version: 1
2+
version: 2
33
type: data
44
spec: spec.yaml
55
extra_config: storage.yaml

assets/pipelines/data/global_dataset/generic_csv/bigbenchhard/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,7 @@ $schema: https://azuremlschemas.azureedge.net/latest/data.schema.json
22
name: "{{asset.name}}"
33
version: "{{asset.version}}"
44
tags:
5-
azureml.Designer: true
6-
azureml.Designer.name: BIG-Bench Hard
7-
azureml.Designer.dataTypeId: DataFrameDirectory
5+
azureml.Designer: false
86
description: BIG-Bench Hard (BBH) benchmark dataset
97
type: uri_folder
108
path: sample_data/

assets/pipelines/data/global_dataset/generic_csv/frontierscience/asset.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
name: frontierscience
2-
version: 1
2+
version: 2
33
type: data
44
spec: spec.yaml
55
extra_config: storage.yaml

assets/pipelines/data/global_dataset/generic_csv/frontierscience/spec.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,7 @@ $schema: https://azuremlschemas.azureedge.net/latest/data.schema.json
22
name: "{{asset.name}}"
33
version: "{{asset.version}}"
44
tags:
5-
azureml.Designer: true
6-
azureml.Designer.name: FrontierScience
7-
azureml.Designer.dataTypeId: DataFrameDirectory
5+
azureml.Designer: false
86
description: FrontierScience benchmark dataset
97
type: uri_folder
108
path: sample_data/

assets/pipelines/data/global_dataset/generic_csv/gpqa_diamond/asset.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
name: gpqa_diamond
2-
version: 1
2+
version: 2
33
type: data
44
spec: spec.yaml
55
extra_config: storage.yaml

0 commit comments

Comments
 (0)