Skip to content

Ghost OS v2.2.0

Choose a tag to compare

View all tags
@mcheemaa mcheemaa released this 12 Mar 04:33
· 12 commits to main since this release
v2.2.0
f54cf0a

Self-Learning Recipes

Ghost OS can now watch you work and learn from it.

Say "watch me send an email" -- Ghost OS observes every click, keystroke, and app switch with full accessibility context. Then Claude synthesizes your actions into a replayable recipe.

New tools

Tool Purpose
ghost_learn_start Begin recording user actions
ghost_learn_stop Stop recording, return enriched action sequence
ghost_learn_status Check recording state and stats

29 tools total (was 26).

How it works

You: "Watch me send an email in Gmail"
Claude: calls ghost_learn_start
You: manually compose and send the email
You: "Done"
Claude: calls ghost_learn_stop -> gets 12 enriched actions with AX context
Claude: synthesizes a parameterized recipe from the recording
Claude: calls ghost_recipe_save -> recipe installed
You: "Send an email to alice@example.com"
Claude: calls ghost_run with the learned recipe

What gets captured

  • Clicks with element role, title, DOM id, computed name, parent role
  • Keystrokes coalesced into typed text (500ms grouping)
  • Hotkeys (Cmd+C, Cmd+V, etc.)
  • App switches (Cmd+Tab, Dock clicks, gestures)
  • Scroll events coalesced (300ms grouping)
  • Right-clicks and double-clicks detected

Privacy

  • Password fields detected via 3-tier check (role, subrole, name patterns)
  • Keystrokes in secure fields replaced with placeholder
  • Restricted apps silently skipped (Keychain Access, System Preferences)
  • All data ephemeral -- never written to disk

Requirements

  • Input Monitoring permission (System Settings > Privacy & Security > Input Monitoring)
  • This is separate from Accessibility and optional -- only needed for learning mode
  • ghost doctor checks this, ghost setup walks you through it

Install

Homebrew (recommended):

brew update && brew upgrade ghost-os

Manual:

curl -L https://github.com/ghostwright/ghost-os/releases/download/v2.2.0/ghost-os-2.2.0-macos-arm64.tar.gz | tar xz -C /tmp/ghost-install
sudo cp /tmp/ghost-install/ghost /opt/homebrew/bin/
sudo cp /tmp/ghost-install/ghost-vision /opt/homebrew/bin/
ghost doctor
Assets 3
Loading