Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
-
Updated
Apr 13, 2026 - Python
#
ai-benchmark
Here are 63 public repositories matching this topic...
An agent benchmark with tasks in a simulated software company.
-
Updated
Nov 17, 2025 - Python
Frontier Models playing the board game Diplomacy.
-
Updated
Feb 11, 2026 - Python
The definitive benchmark for AI agents on OpenClaw. 45 tasks across 4 tiers. Powered by MyClaw.ai
-
Updated
Mar 9, 2026 - Python
Ranking LLMs on agentic tasks
-
Updated
Nov 18, 2025 - Jupyter Notebook
llmBench is a high-depth benchmarking tool designed to measure the raw performance of local LLM runtimes (Ollama, llama.cpp) while providing deep hardware intelligence.
-
Updated
Mar 15, 2026 - Python
🤖 A curated list of resources for testing AI agents - frameworks, methodologies, benchmarks, tools, and best practices for ensuring reliable, safe, and effective autonomous AI systems
testing qa benchmark machine-learning evaluation chaos artificial-intelligence chaos-monkey testing-tools awesome-list quality-assurance ai-safety ai-agents chaos-engineering llm llm-evaluation agentic-ai ai-benchmark agent-evaluation
-
Updated
May 28, 2025
Benchmark for evaluating AI epistemic reliability - testing how well LLMs handle uncertainty, avoid hallucinations, and acknowledge what they don't know.
python nlp benchmark machine-learning ai evaluation collaborate ai-safety llm llm-evaluation hallucination-detection ai-benchmark llm-benchmark
-
Updated
Mar 22, 2026 - Python
MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments and tool use. Supports multiple providers (OpenAI, Google, Anthropic, DeepSeek, Mistral AI, xAI, Alibaba, Moonshot AI, OpenRouter), custom tasks in YAML, and HTML/CSV/JSON reports.
opensource openai xai artificial-intelligence-projects anthropic ai-tool openrouter qwen deepseek mistral-ai llm-evaluation-framework google-gemini-ai llm-benchmarking moonshot-ai language-models-ai llm-comparison ai-benchmark ai-evaluation-tools grok-ai ai-model-comparison
-
Updated
Apr 11, 2026 - Go
GTA (Guess The Algorithm) Benchmark - A tool for testing AI reasoning capabilities
python docker flask benchmark machine-learning puzzle reverse-engineering educational pattern-recognition ctf binary-analysis algorithm-analysis computational-thinking algorithmic-reasoning ai-benchmark
-
Updated
Jan 12, 2025 - Python
This repository contains the results and code for the MLPerf™ Storage v2.0 benchmark.
-
Updated
Aug 4, 2025 - Python
A curated list of evaluation tools, benchmark datasets, leaderboards, frameworks, and resources for assessing model performance.
-
Updated
Mar 10, 2026 - Python
The first comprehensive benchmark for evaluating AI coding agents on Salesforce development tasks. Tests Apex, LWC, Flows, and more.
-
Updated
Jan 27, 2026 - Python
Can AI agents do real science? Benchmarking AI agents on KASCADE cosmic ray classification
-
Updated
Apr 16, 2026 - Python
Benchmark local LLM models: speed, quality, and hardware fitness scoring. CLI, MCP server, and IDE plugins.
-
Updated
Mar 16, 2026 - TypeScript
La Perf is a framework for AI performance benchmarking — covering LLMs, VLMs, embeddings, with power-metrics collection.
cuda mps mlx nvidia-gpu apple-silicon ollama lmstudio ai-performance ai-benchmark ml-benchmark open-source-benchmark
-
Updated
Dec 1, 2025 - Python
RetardBench is an open, no-censorship benchmark that ranks large language models purely on how retarded they are.
jailbreak large-language-models llm prompt-injection red-teaming-tools ollama llm-evaluation uncensored-llm open-llm-leaderboard llm-jailbreaks prompt-injection-llm-security ai-benchmark ai-red-teaming llm-benchmark
-
Updated
Mar 2, 2026 - TypeScript
Python Performance Tester & More...
speedtest performance-analysis specs geekbench performance-test computer-specs gpu-testing python-performance python-performance-test pypc-tests mitchell-shibilski-unkel pypc gpu-test ai-benchmark
-
Updated
Feb 15, 2026 - Python
A technical guide and live-tracking repository for the world's top AI models, specialized by coding, reasoning, and multimodal performance.
-
Updated
Feb 26, 2026
PlayBench is a platform that evaluates AI models by having them compete in various games and creative tasks. Unlike traditional benchmarks that focus on text generation quality or factual knowledge, PlayBench tests models on skills like strategic thinking, pattern recognition, and creative problem-solving.
-
Updated
Apr 2, 2026 - Blade
Improve this page
Add a description, image, and links to the ai-benchmark topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-benchmark topic, visit your repo's landing page and select "manage topics."