A simple Next.js chatbot app to demonstrate the use of embedding models for RAG through the Vercel AI Gateway.

Getting Started

Deploy your own

You can deploy your own version of the demo to Vercel with one click:

Running locally

1. Install the Vercel CLI if you don't already have it
2. Clone the repository you created above: git clone <repo-url>
3. Link it to a Vercel project: vc link or vc deploy
4. Install packages with pnpm i (or npm i or yarn i)
5. Pull environment variables with vc env pull
6. Run a database migration with the following commands:

pnpm db:migrate
pnpm db:push

7. Run the development server with vc dev and open http://localhost:3000 to try the chatbot

FAQ

1. If you prefer running your local development server directly rather than using vc dev, you'll need to run vc env pull to fetch the project's OIDC authentication token locally
   1. the token expires every 12h, so you'll need to re-run this command periodically.
   2. if you use vc dev it will auto-refresh the token for you, so you don't need to fetch it manually
2. If you're linking to an existing, older project, you may need to enable the OIDC token feature in your project settings.
   1. visit the project settings page (rightmost tab in your project's dashboard)
   2. search for 'OIDC' in settings
   3. toggle the button under "Secure Backend Access with OIDC Federation" to Enabled and click the "Save" button
3. See this page to learn how AI Gateway billing works

Authors

This repository is maintained by the Vercel team and community contributors.

Contributions are welcome! Feel free to open issues or submit pull requests to enhance functionality or fix bugs.