Flutter run on iOS simulator never finishes

[chip2n]

I'm trying to run my Flutter integration tests on an iOS simulator. The xcode build finishes, but the test never starts because (I assume) it's waiting for the simulator to finish launching. After 12 minutes, it times out.

I've tried connecting via SSH, launching the emulator manually and then trying to execute flutter run, which also never finishes.

Here's the config:

workflows:
  test-integration-ios:
    name: iOS integration tests
    max_build_duration: 120
    instance_type: mac_mini_m1
    environment:
      flutter: stable
      xcode: latest
    cache:
      cache_paths:
        - $HOME/Library/Caches/CocoaPods
        - $FLUTTER_ROOT/.pub-cache
    scripts:
      - name: Get Flutter packages
        script: | 
          flutter packages pub get
      - name: Run codegen
        script: |
          flutter pub run build_runner build -d
      - name: iOS integration tests
        script: |
          flutter emulators --launch apple_ios_simulator
          flutter -d iPhone test integration_test/main_test.dart

The log for the test stage is basically (I have removed most loading messages):

00:00 +0: loading /Users/builder/clone/integration_test/main_test.dart                                                                                                                                 
...
                  Running Xcode build...                                          
...
01:26 +0: loading /Users/builder/clone/integration_test/main_test.dart                                                                                                                                 
Xcode build done.                                           70.0s
01:27 +0: loading /Users/builder/clone/integration_test/main_test.dart                                                                                                                                 
...
12:00 +0 -1: loading /Users/builder/clone/integration_test/main_test.dart [E]                                                                                                                          
  TimeoutException after 0:12:00.000000: Test timed out after 12 minutes.
  package:test_api/src/backend/invoker.dart 334:28  Invoker._handleError.<fn>
  dart:async/zone.dart 1390:47                      _rootRun
  dart:async/zone.dart 1300:19                      _CustomZone.run
  package:test_api/src/backend/invoker.dart 332:10  Invoker._handleError
  package:test_api/src/backend/invoker.dart 288:9   Invoker.heartbeat.<fn>.<fn>
  dart:async/zone.dart 1398:13                      _rootRun
  dart:async/zone.dart 1300:19                      _CustomZone.run
  package:test_api/src/backend/invoker.dart 287:38  Invoker.heartbeat.<fn>
  dart:async-patch/timer_patch.dart 18:15           Timer._createTimer.<fn>
  dart:isolate-patch/timer_impl.dart 398:19         _Timer._runTimers
  dart:isolate-patch/timer_impl.dart 429:5          _Timer._handleMessage
  dart:isolate-patch/isolate_patch.dart 192:26      _RawReceivePort._handleMessage
  

To run this test again: /Users/builder/programs/flutter/bin/cache/dart-sdk/bin/dart test /Users/builder/clone/integration_test/main_test.dart -p vm --plain-name 'loading /Users/builder/clone/integration_test/main_test.dart'

12:00 +0 -1: Some tests failed.                                                                                                                                                                        


Build failed :|
Step 6 script `iOS integration tests` exited with status code 1

[antoinepemeja]

Hello, since 1 week I have this issue too, before everything worked very well.

https://codemagic.io/app/637280308067d0d1955fd3c0/build/64480f9c1656648db830b515

{"protocolVersion":"0.1.1","runnerVersion":"1.22.0","pid":3884,"type":"start","time":0}
{"suite":{"id":0,"platform":"vm","path":"/Users/builder/clone/integration_test/app_test.dart"},"type":"suite","time":0}
{"test":{"id":1,"name":"loading /Users/builder/clone/integration_test/app_test.dart","suiteID":0,"groupIDs":[],"metadata":{"skip":false,"skipReason":null},"line":null,"column":null,"url":null},"type":"testStart","time":3}
{"count":1,"time":10,"type":"allSuites"}
Running pod install...                                             75.9s
Upgrading Pods-Runner-frameworks.sh
Running Xcode build...                                          
Xcode build done.                                           144.4s
{"testID":1,"error":"TimeoutException after 0:12:00.000000: Test timed out after 12 minutes.","stackTrace":"package:test_api/src/backend/invoker.dart 334:28  Invoker._handleError.<fn>\ndart:async/zone.dart 1390:47                      _rootRun\ndart:async/zone.dart 1300:19                      _CustomZone.run\npackage:test_api/src/backend/invoker.dart 332:10  Invoker._handleError\npackage:test_api/src/backend/invoker.dart 288:9   Invoker.heartbeat.<fn>.<fn>\ndart:async/zone.dart 1398:13                      _rootRun\ndart:async/zone.dart 1300:19                      _CustomZone.run\npackage:test_api/src/backend/invoker.dart 287:38  Invoker.heartbeat.<fn>\ndart:async-patch/timer_patch.dart 18:15           Timer._createTimer.<fn>\ndart:isolate-patch/timer_impl.dart 398:19         _Timer._runTimers\ndart:isolate-patch/timer_impl.dart 429:5          _Timer._handleMessage\ndart:isolate-patch/isolate_patch.dart 192:26      _RawReceivePort._handleMessage\n","isFailure":false,"type":"error","time":720164}
{"testID":1,"result":"error","skipped":false,"hidden":false,"type":"testDone","time":720171}
{"success":false,"type":"done","time":720175}

Thank you

[mohammedbabelly20]

Hey @chip2n & @antoinepemeja
I think there's something wrong with the latest iOS version (16.4) that's why it's not being launched correctly.

I suggest for now using an older iOS version to do your tests.
Here's the script you need to use to create and launch another simulator:

DEVICE=$(xcrun simctl create test-device com.apple.CoreSimulator.SimDeviceType.iPhone-13-Pro-Max com.apple.CoreSimulator.SimRuntime.iOS-15-4)

open -a Simulator --args -CurrentDeviceUDID $DEVICE

And you cal always see the installed ones by running xcrun xctrace list devices

[antoinepemeja]

On my MacBook Pro (M1, 2020) I use the latest version of iOS and it works (Simulator iPhone 14 Pro Max iOS 16.4 + Xcode 14.3). Do you think you can make it work on your end too? Thanks a lot for your help.