Skip to content

Add AI Detector Arena Benchmark to Image Datasets#27

Open
twixpiks wants to merge 1 commit intoDaisy-Zhang:mainfrom
twixpiks:main
Open

Add AI Detector Arena Benchmark to Image Datasets#27
twixpiks wants to merge 1 commit intoDaisy-Zhang:mainfrom
twixpiks:main

Conversation

@twixpiks
Copy link
Copy Markdown

Summary

Adding AI Detector Arena Benchmark - a standardized benchmark dataset for evaluating AI-generated image detection tools.

Dataset Highlights

Metric Value
Total Images 2,038
AI-Generated 1,018
Real Photos 1,020
AI Generators 17
Categories 6

Key Features

  • Balanced Dataset — Equal split between AI-generated and real images
  • Diverse Generators — 17 state-of-the-art AI image generators (DALL-E 3, Midjourney, Stable Diffusion, Flux, etc.)
  • Multiple Categories — Portrait, Landscape, Art, Food, Animal, Product
  • Live Leaderboard — Real-time comparison of detector performance
  • Versioned — Dataset versions ensure reproducible results

Links

Changes Made

  1. Added to Image Datasets list with paper/download links
  2. Added row to Image Datasets table with statistics
  3. Added to Tools section (live benchmark platform)

This benchmark provides a valuable resource for researchers working on deepfake/AI image detection, offering standardized evaluation across multiple generators and categories.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant