LLM Hippodrome

A debating arena for LLMs to come to a shared conclusion on any topic.

Link to site - https://llm-hippodrome.vercel.app/

Overview

LLM Hippodrome is a Next.js application that allows users to submit a prompt and have multiple AI models debate their responses until they reach a consensus. The application leverages models from various providers including Google, Meta, Mistral, DeepSeek, Qwen, and many others via OpenRouter.

Features

• Extensive Model Selection: Choose from over 50 models across 20+ companies including Google, Meta, Mistral, DeepSeek, Qwen, NVIDIA, Microsoft, and many more.
• Initial Responses: View each model's initial response to your prompt in real-time as they come in.
• Debate Rounds: Watch as models evaluate each other's responses and debate their positions.
• Streaming Responses: See model responses as they are being generated rather than waiting for all to complete.
• Robust Consensus Building: Enhanced logic ensures a consensus is always reached through various fallback mechanisms.
• Final Answer: Get a final consensus answer from all participating models.

Getting Started

Prerequisites

You'll need an API key for:

• OpenRouter (required for all models)

Getting an OpenRouter API Key

1. Visit OpenRouter's website and create an account

   • You can sign in with Google, GitHub, or email
   • This is required to access all models in the application

2. After signing in, navigate to the API Keys section

   • You'll find this in the left sidebar menu

3. Click on the "+ Create Key" button to generate a new API key

   • A dialog will appear to configure your key

4. Configure your key:

   • Give your key a name (e.g., "LLM Hippodrome")
   • Set your rate limit or leave as default
   • Optionally set other parameters like request TTL

5. Copy the generated API key

   • It will look something like: sk-or-v1-xxxxxxxxxxxxxxxxxxxxxxxxxxxx
   • Make sure to copy it immediately as you won't be able to see it again

6. Use the key in LLM Hippodrome:

   • When you first open the application, you'll see an API key input field
   • Paste your key into this field and click "Save Key"
   • Your key is stored locally in your browser and is sent only to OpenRouter (never to our servers)

7. Free tier benefits:

   • OpenRouter provides new accounts with free credits
   • These refresh daily, so you can use the application without payment
   • Free tier allows access to most models with reasonable rate limits
   • For more intensive usage, you can add credits to your OpenRouter account

If you need to update or change your API key, click "Edit" in the API key section of the application.