Skip to content

Test command with Maestro runs ~6s faster when Maestro Studio is open #348

@SeanBarker182

Description

@SeanBarker182

Describe the bug
When running a test command with Maestro, the test runs around 6 seconds faster if Maestro Studio is open with the test device connected.

To Reproduce

Command:

flashlight test --bundleId com.pizzaapp --testCommand "MAESTRO_APP_ID=com.pizzaapp npx @perf-profiler/maestro@latest test .maestro/flows/Login.yaml"

Test file:

https://github.com/infinitered/ignite/blob/master/boilerplate/.maestro/flows/Login.yaml

Steps to reproduce the behavior:

  1. npx ignite-cli@latest new PizzaApp --yes
  2. yarn android
  3. Open Maestro Studio and select the device that you'll be running the test in
  4. flashlight test --bundleId com.pizzaapp --testCommand "MAESTRO_APP_ID=com.pizzaapp npx @perf-profiler/maestro@latest test .maestro/flows/Login.yaml"
  5. Observe Average Test Runtime
  6. Close Maestro Studio
  7. flashlight test --bundleId com.pizzaapp --testCommand "MAESTRO_APP_ID=com.pizzaapp npx @perf-profiler/maestro@latest test .maestro/flows/Login.yaml"
  8. Observe that Average Test Runtime is ~6s longer

Screenshots
Image

Environment (please complete the following information):

  • OS: macOS 26.0.1
  • Flashlight Version: 0.18.0
  • Android SDK platform tools version: Android Debug Bridge version 1.0.41 Version 36.0.0-13206524 Running on Darwin 25.0.0 (arm64)
  • Test Framework: Maestro v2.0.3
  • Share the bundle identifier of your app: com.pizzaapp

Additional context
This might be more of a Maestro issue. I just wanted to share it here just in case others were having similar issues with test runtime inconsistencies.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Package:CLIBug or feature concerning cli tools (measure, test, report, tools, ...)Status:UnconfirmedA potential issue that we haven't yet confirmed as a bug from the library

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions