Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
121 commits
Select commit Hold shift + click to select a range
6bbc2bb
Add posthog integration for error logging
kcarnold Nov 11, 2025
83a981e
staging a visual bug to check for CI workflow
Alina086 Nov 17, 2025
9478c67
draft backend and frontend error testing
kdh29 Nov 18, 2025
1b14a45
fix: update unused input parameter + comment cleanups
Alina086 Nov 25, 2025
47c920e
fix: unstage the intentional bug
Alina086 Nov 25, 2025
55efdd1
test: update baseline images
Alina086 Nov 25, 2025
a7e6dbf
chore: documenting instructions for running test
Alina086 Nov 25, 2025
bd98ce7
Merge branch 'main' of github.com:AIToolsLab/writing-tools into test/…
Alina086 Nov 25, 2025
90584ea
chore: add detailed instructions on running the test
Alina086 Nov 25, 2025
56d8e50
feat; posthog llm analytics
kdh29 Nov 25, 2025
a5e5a98
ideas from the summer
kcarnold Nov 25, 2025
d486ee1
Import experiment code that I'd prototyped in a different repo
kcarnold Dec 2, 2025
68f9974
test: set up mock backend for /api/get_suggestion endpoint
Alina086 Dec 2, 2025
de015ce
test: add playwright tests for the main flows in draft component of d…
Alina086 Dec 2, 2025
1624bc8
Initial full-experiment spike (from last night)
kcarnold Dec 2, 2025
d131067
Fix usage of ai-sdk
kcarnold Dec 2, 2025
a128514
minor tweaks
kcarnold Dec 2, 2025
96cf2a4
Merge pull request #308 from AIToolsLab/test/playwright-automation
Alina086 Dec 2, 2025
be3e596
Fix PR #316 review comments: Add TLX questions, improve logging, refa…
kcarnold Dec 2, 2025
31ff5da
backlog.md instructions for CLAUDE.md (but this takes a lot of tokens…
kcarnold Dec 2, 2025
2d8cb63
remove unused stuff in .gitignore (it was blocking adding `lib` folder)
kcarnold Dec 2, 2025
8427f40
Refactor study components: unify autoRefreshInterval handling, update…
kcarnold Dec 3, 2025
8491955
Fix typing
kcarnold Dec 3, 2025
7f10590
Bookkeeping
kcarnold Dec 3, 2025
f4cbc05
Avoid logging auto-refresh events
kcarnold Dec 3, 2025
acec051
new task
kcarnold Dec 3, 2025
ecdb7e7
Add chat message logging to ChatPanel component
kcarnold Dec 3, 2025
002c359
note that suggestions auto-update
kcarnold Dec 3, 2025
c179723
task-10 completed last night
kcarnold Dec 3, 2025
920db5d
WIP testing
kcarnold Dec 3, 2025
1474661
more WIP testing, still not quite right
kcarnold Dec 3, 2025
7fd6bf4
Add some tasks
kcarnold Dec 3, 2025
7d97646
fix testing utils
kcarnold Dec 3, 2025
1247403
add display bug task
kcarnold Dec 3, 2025
1545e63
factor out CLAUDE.md into frontend and backend.
kcarnold Dec 3, 2025
33bc1fb
Finished task 12.
kcarnold Dec 3, 2025
dbea464
Started work on task-7 but I'm not sure I really want to do this.
kcarnold Dec 3, 2025
12d6812
WIP: chat messages with timing delay
kcarnold Dec 3, 2025
3777b38
useless tests
kcarnold Dec 4, 2025
0e58939
Simplify logic, revert to streaming
kcarnold Dec 4, 2025
2806a80
update tests
kcarnold Dec 4, 2025
65b5ffc
Log the actual displayed messages
kcarnold Dec 4, 2025
3db65a3
Fix jotai nextjs Provider-less mode
kcarnold Dec 4, 2025
6e32b5d
update tasks
kcarnold Dec 4, 2025
5f9d40e
Log each message in a multi-part message, with the time it was actual…
kcarnold Dec 4, 2025
cf36ad1
Merge pull request #315 from AIToolsLab/test/update-mockbackend
Alina086 Dec 4, 2025
b6b58c7
css-fix: fix oversize sidebar (backlog task-13)
Alina086 Dec 5, 2025
2a9fc06
Fix scrolling to bottom on new messages
kcarnold Dec 5, 2025
2d64364
fix status in tests
kcarnold Dec 5, 2025
e7caebe
Make the complete_document mode visible in the UI
nghtctrl Dec 6, 2025
3e312d7
Add prompt for complete_document mode (prompt was copied over from nl…
nghtctrl Dec 6, 2025
22f6c56
Address a React Server Components vuln
kcarnold Dec 6, 2025
e89cf82
scroll-to-bottom tests
kcarnold Dec 6, 2025
b992015
Change task-14 status to Done
nghtctrl Dec 6, 2025
a386833
update system message for explicit delegation & add fake name
Alina086 Dec 8, 2025
433fa97
lowered Sarah's reading/typing speed to be more realistic, added more…
jooha-yoo Dec 8, 2025
fe99129
Merge branch 'main' into posthog
kdh29 Dec 10, 2025
b2e3dff
fix for failed lint build
kdh29 Dec 10, 2025
de1abd3
fix: address PR feedback - remove redundant PostHog init, fix package…
kdh29 Dec 16, 2025
9eb7e2f
Merge pull request #303 from AIToolsLab/posthog
kdh29 Dec 17, 2025
919583f
Revert "Merge pull request #303 from AIToolsLab/posthog"
kcarnold Dec 17, 2025
6a938f8
Build container for experiment
kcarnold Dec 19, 2025
9bb8979
need typescript (and other dev dependencies) to run build
kcarnold Dec 19, 2025
b6f250d
Simplify git commit gathering
kcarnold Dec 19, 2025
468103a
remove unused copilot instructions (copilot will find CLAUDE.md)
kcarnold Dec 19, 2025
73de977
Merge remote-tracking branch 'origin/main' into proj/measuring-thinki…
kcarnold Jan 5, 2026
561e58e
Remove Claude stuff
kcarnold Jan 5, 2026
e4ee0e1
Make security a bit more robust for using username in paths
kcarnold Jan 5, 2026
7b246d0
Try harder to avoid the security warning
kcarnold Jan 5, 2026
6f947e8
Standalone only in Docker
kcarnold Jan 5, 2026
45e0210
bump nodejs version
kcarnold Jan 5, 2026
f79c7e8
Use the same image as frontend
kcarnold Jan 5, 2026
556217b
Merge pull request #316 from AIToolsLab/proj/measuring-thinking-exper…
kcarnold Jan 5, 2026
c362d78
Vibe coded chat collapsable tab
nghtctrl Jan 6, 2026
af78feb
Remove some stuff from README
kcarnold Jan 8, 2026
7abafbb
Add auto-expand for chat after a delay
kcarnold Jan 8, 2026
384508c
Tweak the initial messages
kcarnold Jan 8, 2026
e042b98
Sarah sends a follow-up if no questions asked
kcarnold Jan 8, 2026
a9cf20c
Explain the situation a bit more
kcarnold Jan 8, 2026
be5b56b
document the purpose of the experiment for Claude
kcarnold Jan 8, 2026
a3fb85d
maybe a company tone doc
kcarnold Jan 8, 2026
640431c
Apply the edit to the correct page
kcarnold Jan 8, 2026
fa7eeba
Merge pull request #324 from AIToolsLab/separate-chat
kcarnold Jan 8, 2026
d58e95a
log to the right place
kcarnold Jan 8, 2026
2dc17d2
persist experiment logs
kcarnold Jan 8, 2026
2d1a8b4
Fix log mountpoint, since the experiment dockerfile runs everything i…
kcarnold Jan 9, 2026
32e08da
try looking up the correct GID.
kcarnold Jan 9, 2026
eec7c57
declare the GID arg in the correct stage
kcarnold Jan 9, 2026
f6c13fe
Add the nextjs user to the group
kcarnold Jan 9, 2026
c974049
Oops, syntax error
kcarnold Jan 9, 2026
b71e28a
Don't show an email address for the participant
kcarnold Jan 12, 2026
57e1dc4
Support multiple scenarios
kcarnold Jan 12, 2026
0fe5ee7
Fix some hardcoded Sarah
kcarnold Jan 12, 2026
b25154f
Update docs for configurable scenarios
kcarnold Jan 13, 2026
8d35af1
Don't need a field for From
kcarnold Jan 13, 2026
2a69ea1
bump nextjs version
kcarnold Jan 13, 2026
0dad319
Move Send button to the header
kcarnold Jan 13, 2026
4bc60d5
clarify the error message
kcarnold Jan 13, 2026
88cd598
bump model to gpt-5.2 (cheaper and better)
kcarnold Jan 13, 2026
a0c628d
remove done todos
kcarnold Jan 13, 2026
198b66a
Don't store duplicate results (usually "insufficient content" messages)
kcarnold Jan 13, 2026
cc7af8c
Bump the writing recommendation model to GPT 5.2 also
kcarnold Jan 13, 2026
239c3e0
Clarify the non-example suggestion types
kcarnold Jan 13, 2026
8cb25f0
add back a sender name
kcarnold Jan 13, 2026
ecef281
Add coverage module for vitest
kcarnold Jan 13, 2026
3b2aa35
Avoid double-logging messages by explicitly managing logging events
kcarnold Jan 13, 2026
06dea14
scroll to bottom when typing
kcarnold Jan 13, 2026
b4f50f3
simplify timer cleanup
kcarnold Jan 13, 2026
eec1af3
update tests
kcarnold Jan 13, 2026
819d6af
advanced too much
kcarnold Jan 13, 2026
45a5a81
silly linter stuff
kcarnold Jan 15, 2026
734595f
Tighten down types on study params
kcarnold Jan 15, 2026
545f52c
bump wave
kcarnold Jan 15, 2026
0ec8a1a
refactor page view to improve type safety; log the study params
kcarnold Jan 15, 2026
e53f3d9
try to flush out a logging bug, still haven't caught it
kcarnold Jan 15, 2026
599493b
Fix stale closure: we were using displayed part for the previous message
kcarnold Jan 15, 2026
917c636
buggy test
kcarnold Jan 15, 2026
b35678e
Log the AI data and response!
kcarnold Jan 15, 2026
3777a78
log the final text
kcarnold Jan 15, 2026
5313933
vibe-coded analysis scripts (based on previous analysis scripts and c…
kcarnold Jan 15, 2026
d54915f
Load scenarios from JSON for both the experiment and the log analysis
kcarnold Jan 15, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
129 changes: 0 additions & 129 deletions .github/copilot-instructions.md

This file was deleted.

25 changes: 4 additions & 21 deletions .github/workflows/playwright.yml
Original file line number Diff line number Diff line change
@@ -1,19 +1,11 @@
name: Playwright Tests
name: Playwright Visual Regression Tests
on:
# push:
# branches: [ main ]
# pull_request:
# branches: [ main ]
workflow_dispatch: # Enables manual triggering only
inputs:
update-snapshots:
description: 'Update visual snapshots'
required: false
type: boolean
default: false
workflow_dispatch: # Manual trigger only

defaults:
run:
working-directory: frontend

jobs:
test:
timeout-minutes: 60
Expand All @@ -31,19 +23,10 @@ jobs:
run: npm run build
- name: Run Playwright tests
run: npx playwright test
# Playwright will automatically start the frontend via webServer config
# API calls are mocked in the test file with page.route()
- uses: actions/upload-artifact@v4
if: ${{ !cancelled() }}
with:
name: playwright-report
path: frontend/playwright-report/
retention-days: 30
- name: Upload updated snapshots
if: github.event.inputs.update-snapshots == 'true'
uses: actions/upload-artifact@v4
with:
name: updated-snapshots
path: frontend/tests/**/*-snapshots/**
retention-days: 30

18 changes: 0 additions & 18 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,20 +6,6 @@ __pycache__/
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
Expand Down Expand Up @@ -47,7 +33,3 @@ node_modules/

# Data
*.db

# Azurite
__azurite_*

Loading