Claude Computer Use doesn't scroll enough

[juecd]

Claude likes to scroll by nominal amounts (3-10 px), which aren't enough to see changes on the screen. System prompting doesn't seem to help. We should remap this in our sampling loop.

[matthewjmarangoni]

Instructing in the invocation query to use the page keys instead of scrolling did not work reliably.

I found some success when changing the system prompt to include:

• When you need to scroll or scrolling is requested, use the PgUp and PgDn keyboard keys instead.

A downside of that being scrolling is now limited to full page movements.

Using the page keys requires adding some additional key mappings (page_up, page_down). PR #21 addresses this mapping.

The values Claude generates made me consider that it is generating not pixels but instead scroll steps similar to the tactile clicks of a scroll wheel on some mice which are then usually scaled by some line count.

Determining a line height to scale by or figuring out some other factor paired with clamping are potential solutions. A PR is incoming.

[juecd]

Fixed by #23