Skip to content

Onboard TruthfulQA dataset#4780

Merged
AbdelmohsenMS merged 6 commits intomainfrom
copilot/add-truthfulqa-dataset
Feb 13, 2026
Merged

Onboard TruthfulQA dataset#4780
AbdelmohsenMS merged 6 commits intomainfrom
copilot/add-truthfulqa-dataset

Conversation

Copy link
Contributor

Copilot AI commented Feb 12, 2026

Adds TruthfulQA dataset configuration following the GPQA Diamond pattern (PR #4734).

Changes

  • Dataset configuration: Created truthfulqa asset under assets/pipelines/data/global_dataset/generic_csv/

    • asset.yaml: Dataset metadata (name, version, type)
    • spec.yaml: Azure ML Designer tags and uri_folder type
    • storage.yaml: Azure blob storage path pointing to foundry_benchmark_dataset_assets/TruthfulQA/v1
  • Schema definition: 7 string columns in sample_data/schema/_schema.json

    • Type, Category, Question, Best_Answer, Correct_Answers, Incorrect_Answers, Source
  • Sample data metadata:

    • _meta.yaml: CSV format configuration referencing TruthfulQA.csv
    • license.txt: CC BY 4.0 license

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 3 commits February 12, 2026 23:38
Co-authored-by: AbdelmohsenMS <127798197+AbdelmohsenMS@users.noreply.github.com>
Co-authored-by: AbdelmohsenMS <127798197+AbdelmohsenMS@users.noreply.github.com>
Co-authored-by: AbdelmohsenMS <127798197+AbdelmohsenMS@users.noreply.github.com>
Copilot AI changed the title [WIP] Add TruthfulQA dataset for onboarding Onboard TruthfulQA dataset Feb 12, 2026
Copilot AI requested a review from AbdelmohsenMS February 12, 2026 23:41
Replaced Creative Commons license text with Apache License 2.0.
@github-actions
Copy link

github-actions bot commented Feb 12, 2026

Test Results for assets-test

0 tests   0 ✅  0s ⏱️
0 suites  0 💤
0 files    0 ❌

Results for commit 35b370b.

♻️ This comment has been updated with latest results.

imatiach-msft
imatiach-msft previously approved these changes Feb 12, 2026
@AbdelmohsenMS AbdelmohsenMS merged commit b5d64e7 into main Feb 13, 2026
53 of 54 checks passed
@AbdelmohsenMS AbdelmohsenMS deleted the copilot/add-truthfulqa-dataset branch February 13, 2026 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

safe to publish Pull request containing new asset has been tested properly

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants