Chad/prototype (#1)

* start work on prototype

* start of prototype, gen types, sdk, tests

* added openrouter and prompt tester

* start on more robust data schema and api routes

* cursor written api endpoint tests

* move files around, add placeholders for bullmq, rest services

* fix nextjs public folder

* slight adjustment to typegen cmd

* path fixes for build passing

* add supabase github actions, and first migration, delete agent rest api exploration

* fix gh actions directory

* seeding and migration changes

* fucking tests man

* add llm logs table

* sign in with github auth

* add tests to gh actions

* try updating cli version for running tests

* try latest?

* refactored openrouter implementation to work with vault and code verifier per user

* add pgTAP tests for new rpc fns

* consolidate supabase migration check and tests into one workflow

* rename workflow

* test prompt running

* change app to studio routes, add prompt pages from supabase, add llm logs view, RLS, and RLS tests

* start onboarding logic

* upgrade tailwind to v4, add onboarding logic

* add org and project switcher, adjust client side context, consolidate migration, refactor user_keys into organization_keys

* refactor routes

* layout and context kinda fixed

* adjust prompt schema, adjust openrouter calling, fix routing on some pages

* fix ts err for now

* openrouter clean up, org page listing users

* prompts pages, template extracting, component consolidation

* remove uneeded code

* prompt editorial workflow fixes

* add api tests

* move util

* shadcn overhaul, colors, and themes

* refactor keys so orgs get an sdk api key on creation, allow for users to execute via api key, add api key reveal component to org page

* fix prompt config saving, add additional openrouter typing

* finish services refactor

* progress towards github repo sync

* start of sync work that was vibing so it probably doesnt work

* refactor migration into using schemas

* remove test migration, replace initial schema migration

* attempt to pin postgres-version because of permissions error

* Refactor GitHub App installation flow

Create a pending installation record before redirecting to GitHub.
Verify the installation on callback against the pending record and
GitHub user installations.

On successful verification, activate the installation and create
repository records for all accessible repositories linked to the
organization.

* Create .prettierrc.json

* Github App installation record flow working (still need to save and
refresh provider tokens in future update, right now it will only work if
we install the app directly after logging in before the token expires)

Got github webhooks updating the installation record working with a
github_webhook service account and role.

* Remove supabase declarative schemas, still kinda buggy

refactor installation validation to just check for the installation via
app REST request rather than user oauth REST request

adjust the connecting modal

* Refactor: Centralize external URLs in routes utility

Consolidate GitHub and OpenRouter URLs into a new `src/utils/routes.ts`
utility for improved maintainability and consistency across the codebase.

Update relevant services and components to use the new routes object.
Pass project UUID during GitHub project connection. Add UI check for
incomplete GitHub app installation.

* Add GitHub repository sync functionality

This provides project-level sync capability with GitHub and improves
repository connection handling.

Changes include:
- Add sync button and action to project page
- Enhance repository sync logic
- Add unique constraint to active GitHub app installations
- Fix installation ID handling
- Also add tests for github_app_installations and project_repositories

* Enhance project connection and repository handling

This update introduces several improvements to the project connection process and repository management. Key changes include:
- Added organization UUID to the connectProject function.
- Updated the ConnectProjectModal to handle default repository IDs.
- Enhanced GitHub service to store repository default branch information.
- Improved error handling in prompt version creation and updates.
- Refactored code for better readability and maintainability.

These changes aim to streamline the integration with GitHub and improve user experience when connecting projects.

* Update project_repositories test to include default branch

This commit enhances the project_repositories test by adding the repository_default_branch field to the insert statements. The default branch is now set to 'main' for all test cases, ensuring consistency and accuracy in repository data handling during tests.

* Refactor GitHub services and update user authentication handling

This commit includes significant refactoring of the GitHub services, transitioning from a single GitHubService to multiple specialized services: GitHubAppService, GitHubWebhookService, and GitHubSyncService. Additionally, the user authentication process has been streamlined by replacing the initialize method with a getAuthUser method across various components and services. The connectProject action has been moved, and related imports have been updated accordingly. These changes aim to enhance code organization and improve the overall user experience.

* Update environment configuration and enhance template variable handling

This commit modifies the environment configuration to load the default `.env` file in the smee proxy and updates the template variable extraction logic to include a `default_value` field for all variables. Additionally, new types and relationships have been added to the Supabase schema for agentsmith events, for logging sync events. Added tests for variable compiling.

* Big GitHubSync Service refactor

Enhance project data retrieval and user notifications

This commit updates the project data retrieval methods to use UUIDs consistently across the application, improving data integrity and reducing errors. Additionally, it introduces a toast notification system to inform users about project sync events, enhancing user experience. The layout has been updated to include a Toaster component for displaying notifications. Other minor refactorings and optimizations have been made throughout the codebase to improve maintainability.

* Janky but working version of repo -> agentsmith syncing

* complete sync service refactor

* add support for global context

* add erorr alert for authoring with missing globals

* refactor a lot of fe component names, add studio header and hooks

* styling refactors

* logger refactor

* add emoji mode

* fix migration ordering

* comment out test for now

* adjust supabase migrations cicd yml

* adjust landing styling

---------

Co-authored-by: Chad $yntax <chad@ttpspodcast.com>

Author: chad-syntax

.cursor/mcp.json

@@ -0,0 +1,12 @@
+{
+  "mcpServers": {
+    "supabase": {
+      "command": "npx",
+      "args": [
+        "-y",
+        "@modelcontextprotocol/server-postgres",
+        "postgresql://postgres:postgres@127.0.0.1:54322/postgres"
+      ]
+    }
+  }
+}

.cursor/rules/psql.mdc

@@ -0,0 +1,8 @@
+---
+description: 
+globs: *.sql, *.psql
+alwaysApply: false
+---
+1. All psql should be written in lowercase syntax
+2. When creating psql indices we should be as concise as we can, omitting defaults like the index name and the type. So we rather do `create index on table(column)` instead of `create idx_table_column on table using btree (column)`
+3. We should add indices to columns that reference other tables and columns that are queried frequently. e.g. if the column is `slug` it will most likely be queried on that instead of `id` so we should create an index on it.

.cursor/rules/typescript.mdc

@@ -0,0 +1,25 @@
+---
+description: These rules are helpful for contrubuting to the front-end Nextjs code and the typescript code.
+globs: *.tsx, *.ts
+alwaysApply: false
+---
+
+# Agentsmith tsx contributing rules for cursor AI
+
+1. Only use named exports (`export const thing`, not `export default`)¹
+2. All pages should have a single top level page component in page-components
+3. All components should be in components folder either as a single file named after the component or in a subfolder named after the component¹
+4. All functions should be declared in const rocket format: `const rocket = async (payload: any) => { ... }`¹
+5. All props should be explicitly typed as `type ComponentProps = { ... }` and not typed inline ex: `props: { foo: any }` is bad `props: ComponentProps` is good. DO NOT deconstruct props, if a component has props, it should be named as `props` and deconstructed in the body of the component. Write `const foo = (props: FooProps) => { const { arg, arg2 } = props; }` rather than `const foo = ({ arg, arg2 }: FooProps) => {}`
+6. Only use icons from `lucide-react`
+7. Only use tailwind css
+8. Each component file should have at most 2 react components, any more than that and it should be split up into multiple component files/folders.
+9. Any links to pages that exist under the web-studio should be prefixed with /app
+10. All functions that take more than 1 argument, should use an `options` syntax instead of adding many arguments. i.e. `const foo = (options: FooOptions) => {}` rather than `const foo = (bar: string, baz: string, quux: string) => {}`
+11. If the response for a function is an object, then it should be typed separately rather than inline. i.e. `const foo = (): FooResult => {}` instead of `const foo = (): { foo: string; bar: string; baz: string } => {}` 
+12. DO NOT edit any generated files within the `__generated__` folder.
+13. DO NOT create new types if they can be inferred from the supabase generated types OR can be inferred from the return of a supabase.from call using `Awaited<ReturnType><>`
+
+
+¹ Exception for the Nextjs page.tsx files. They should only have one default function export.
+

.env.example

@@ -0,0 +1,36 @@
+# FREE_MODELS_ONLY=true
+
+NEXT_PUBLIC_SITE_URL="http://localhost:3000"
+
+NEXT_PUBLIC_SUPABASE_URL=
+NEXT_PUBLIC_SUPABASE_ANON_KEY=
+
+NEXT_PUBLIC_POSTHOG_KEY=
+NEXT_PUBLIC_POSTHOG_HOST=
+
+SUPABASE_AUTH_GITHUB_CLIENT_ID=
+SUPABASE_AUTH_GITHUB_SECRET=
+
+SUPABASE_JWT_SECRET=
+
+# used for testing local dev
+SMEE_WEBHOOK_PROXY_URL=
+
+GITHUB_APP_NAME=
+GITHUB_APP_ID=
+GITHUB_APP_PRIVATE_KEY=
+GITHUB_APP_WEBHOOK_SECRET=
+GITHUB_WEBHOOK_SERVICE_USER_ID=
+
+
+# TESTING TURNSTILE LOCALLY
+# NEXT_PUBLIC_CF_TURNSTILE_SITE_KEY=1x00000000000000000000AA	# Always passes	visible
+# NEXT_PUBLIC_CF_TURNSTILE_SITE_KEY=2x00000000000000000000AB	# Always blocks	visible
+NEXT_PUBLIC_CF_TURNSTILE_SITE_KEY=1x00000000000000000000BB	# Always passes	invisible
+# NEXT_PUBLIC_CF_TURNSTILE_SITE_KEY=2x00000000000000000000BB	# Always blocks	invisible
+# NEXT_PUBLIC_CF_TURNSTILE_SITE_KEY=3x00000000000000000000FF	# Forces an interactive challenge	visible
+
+# unused right now, but good to have in case we validate on our end
+CF_TURNSTILE_SECRET_KEY=1x0000000000000000000000000000000AA #	Always passes
+# CF_TURNSTILE_SECRET_KEY=2x0000000000000000000000000000000AA #	Always fails
+# CF_TURNSTILE_SECRET_KEY=3x0000000000000000000000000000000AA #	Yields a "token already spent" error

.github/workflows/supabase_migrations_ci.yml

@@ -0,0 +1,36 @@
+name: Supabase Tests
+
+on:
+  pull_request:
+  workflow_dispatch:
+
+jobs:
+  supabase_tests:
+    runs-on: ubuntu-latest
+
+    steps:
+      - uses: actions/checkout@v3
+
+      - uses: supabase/setup-cli@v1
+        with:
+          version: latest
+
+      - name: Overwrite Supabase db version
+        run: |
+          mkdir -p supabase/.temp
+          echo "15.8.1.038" > supabase/.temp/postgres-version
+
+      - name: Start Supabase local development setup
+        run: supabase db start
+
+      - name: Run Tests
+        run: supabase test db
+
+      - name: Verify generated types are checked in
+        run: |
+          supabase gen types typescript --local > types.gen.ts
+          if ! git diff --ignore-space-at-eol --exit-code --quiet types.gen.ts; then
+            echo "Detected uncommitted changes after build. See status below:"
+            git diff
+            exit 1
+          fi

.github/workflows/supabase_migrations_prod.yml

@@ -0,0 +1,27 @@
+name: Push Supabase Migrations to Production
+
+on:
+  push:
+    branches:
+      - main
+  workflow_dispatch:
+
+jobs:
+  push_supabase_migrations_production:
+    environment: Production
+    runs-on: ubuntu-latest
+
+    env:
+      SUPABASE_ACCESS_TOKEN: ${{ secrets.SUPABASE_ACCESS_TOKEN }}
+      SUPABASE_DB_PASSWORD: ${{ secrets.SUPABASE_DB_PASSWORD }}
+      SUPABASE_PROJECT_ID: ${{ secrets.SUPABASE_PROJECT_ID }}
+
+    steps:
+      - uses: actions/checkout@v3
+
+      - uses: supabase/setup-cli@v1
+        with:
+          version: latest
+
+      - run: supabase link --project-ref $SUPABASE_PROJECT_ID
+      - run: supabase db push

.github/workflows/supabase_migrations_staging.yml

@@ -0,0 +1,27 @@
+name: Push Supabase Migrations to Staging
+
+on:
+  push:
+    branches:
+      - staging
+  workflow_dispatch:
+
+jobs:
+  push_supabase_migrations_staging:
+    environment: Staging
+    runs-on: ubuntu-latest
+
+    env:
+      SUPABASE_ACCESS_TOKEN: ${{ secrets.SUPABASE_ACCESS_TOKEN }}
+      SUPABASE_DB_PASSWORD: ${{ secrets.SUPABASE_DB_PASSWORD }}
+      SUPABASE_PROJECT_ID: ${{ secrets.SUPABASE_PROJECT_ID }}
+
+    steps:
+      - uses: actions/checkout@v3
+
+      - uses: supabase/setup-cli@v1
+        with:
+          version: latest
+
+      - run: supabase link --project-ref $SUPABASE_PROJECT_ID
+      - run: supabase db push

.nvmrc

@@ -1 +1 @@
-22.13.1
+22.14.0

.prettierrc.json

@@ -0,0 +1,8 @@
+{
+  "singleQuote": true,
+  "trailingComma": "all",
+  "printWidth": 100,
+  "tabWidth": 2,
+  "useTabs": false,
+  "semi": true
+}

CLAUDE.md

@@ -0,0 +1,28 @@
+# CLAUDE.md - AgentSmith Development Guidelines
+
+## Build and Test Commands
+
+- **Development**: `npm run dev` - Start Next.js dev server
+- **Build**: `npm run build` - Build the Next.js application
+- **Start**: `npm run start` - Start production server
+- **Test**: `npm run test` - Run all tests with Jest
+- **Test (Watch)**: `npm run test:watch` - Run tests in watch mode
+- **Test Single File**: `npm run test -- -t "test name"` or `npm run test -- path/to/file.test.ts`
+- **Type Generation**: `npm run typegen` - Generate Supabase TypeScript types
+
+## Code Style Guidelines
+
+- **Components**: Use named exports only; default exports only for Next.js page files
+- **Functions**: Declare with const arrow format: `const myFunc = (params: Type) => {}`
+- **Types**: Always explicitly type props as separate types, not inline
+- **File Structure**:
+  - Components in `/components` folder with max 2 components per file
+  - Page components in `/page-components`
+- **Imports**: Use path aliases: `@/` for src, `&/` for lib, `~/` for root
+- **Naming**: PascalCase for components, camelCase for functions, kebab-case for files
+- **Icons**: Only use icons from `lucide-react`
+- **Styling**: Only use Tailwind CSS, no custom CSS
+- **SQL**: Lowercase syntax for queries, concise index declarations with `create index concurrently`
+- **Error Handling**: Use try/catch with appropriate error logging
+
+Always follow existing patterns in the codebase.