This game is my submission for the Modern Stack Hackathon
ModlGuessr is a game where you need to find which Large Language Model you're talking with. Inspired by GeoGuessr.
I was looking for a fun idea to built with Convex, Better Auth and Autumn
You pick a difficulty. Easy, medium, hard You enter a chat room You're faced with a description of the AI's persona. ie: "This AI believes it's in the year 1995. Modern references will confuse it." You can chat with the LLM, now knowing which one it is. There are 4 models to chose from As soon as you start chatting, a countdown starts You must pick one of the 4 options before the timer reaches the max. The longer you take to find which one it is, the less points you get This loop repeats 7 times In the end, you get a score and enter a leaderboard
The more correct answers you get in a row, the more you increase a streak multipler A fast LLM checks you managed to force the LLM to tell its name. If you did, you get an extra multiplier.
This is a hackathon project, not a very serious business idea. But, maybe it'll be fun enough, and most of all, I want to implement Autumn and see how it works in a real situation.
So here is the planned model:
- Freemium, with a few free games (ie: 3) initally
- 1 free game per day
- Small subscription plan 9€/mo for more games per month
- One time payment, higher price price per ticket
- Pay as you go for unlimited play
As the main goal is to explore the stack, here are some features we can implement because the tools make it easy.
- Setup SvelteKit
- Setup Convex
- Basic database structure (games)
- Stream LLM calls directly from AI SDK front-end to a Convex HTTP endpoint
- Leaderboard for the best scores (aggregate)
- Live count of all tokens ever used (aggregate)
- Auto-stop round after a given time (scheduled function)
- Fetch and store AI models from Vercel AI Gateway regularly (cron)
- Watch other players playing live
- Setup Better Auth
- Google Auth
- Username plugin
- Find out and implement other relevant providers
- Setup Autumn
- Define plans
- Show and track feature (tickets to play a game)
- Implement and test payment
- CD Pipeline
- Auth is working
- Convex prod is used
- Autumn prod is used
- Create a blog to document learnings
- Gameplay with AI SDK
- Find fun game loops
- Create game rounds
- Save messages
- Display result and score
- Move to next round
- Save final game score
- Enter data in leaderboard
- Suggest next-game
- Different difficulty level
- Generate "contraints" to make the game less repetitive
- Analytics
- Homepage
- Referral program (Autumn + Resend)
- Generate referral code
- Redeem codes
- Notify referer by email when a code is used
- Vapi
- Put a button to call a sales person from pricing page
- Share
- Nice OG images
- Multiplayer
- i18n
Shield:
This work is licensed under a Creative Commons Attribution 4.0 International License.
