new commands: click, type, move mouse, press key, scroll, drag mouse

[rgarcia]

No description provided.

[mesa-dot-dev]

Mesa Description

This PR introduces a suite of commands for programmatic, OS-level control over browser instances. A new computer subcommand has been added to browsers, enabling users to script interactions like mouse movements, clicks, keyboard input, and screen captures.

This significantly expands the CLI's capabilities, allowing for more complex browser automation and testing scenarios.

Key Changes:

• New browsers computer subcommand with the following capabilities:
  • Mouse Control: click-mouse, move-mouse, drag-mouse, scroll
  • Keyboard Input: type (for strings), press-key (for special keys)
  • Screen Capture: screenshot
• Testing: A FakeComputerService was introduced to mock these new interactions, ensuring the commands are thoroughly tested.
• Documentation: The README.md has been updated with a new "Browser Computer Controls" section, detailing each new command and providing usage examples.
• Dependencies: go.mod and go.sum were updated to include necessary dependencies for the new functionality.

^{Description generated by Mesa. Update settings}

[mesa-dot-dev]

Performed full review of 09b6ba1...70abf97

Analysis

1. Missing input validation for coordinate bounds could lead to unpredictable behavior or crashes when actions are performed outside valid screen areas.

2. Security implications of OS-level control through browser interface are not fully addressed, potentially creating vectors for unauthorized system access.

3. Screenshot operations may not properly handle resource cleanup, risking memory leaks or resource exhaustion during extended use.

4. Dependency management using a replace directive indicates reliance on a development or unreleased SDK version, which could cause stability issues or compatibility problems in production.

Tip

⚡ Quick Actions

This review was generated by Mesa.

Actions:

• Configure your agents

Slash Commands:

• /review - Request a full code review
• /review latest - Review only changes since the last review
• /describe - Generate PR description. This will update the PR body or issue comment depending on your configuration
• /help - Get help with Mesa commands and configuration options

^{5 files reviewed | 0 comments | Review on Mesa | Edit Reviewer Settings}