Computer Use needs the full GUI screenshot, not what's provided by Playwright

[juecd]

Currently, the Anthropic Computer Use implementations (Typescript, Python coming soon) rely on Playwright's page.screenshot() functionality and passes the output to the LLM for its next instructions. However, this screenshot doesn't include the full browser window i.e. the address bar. Because of this, Claude cannot see the navbar it types into when it uses cmd-l to focus it.

We should consider using a different mechanism to take screenshots for Claude. The original reference implementation uses gnome-screenshot.

[matthewjmarangoni]

If #30 is merged it could be reverted once this issue is addressed.

[juecd]

We've also heard from a user that this also is a problem when CU wants to monitor for files being downloaded from the Browser.

[juecd]

Related conversation: https://discord.com/channels/1342243238748225556/1383086249656582216/1384956580029534290