Flutter Windows tests failing

[jpohhhh]

If you are looking for help, please confirm the following...

• I confirm I have searched the Docs, Codemagic Sample Projects, and GitHub Discussions.
• I confirm the software versions on my local computer match the ones in CI environment (e.g. Xcode version, Gradle version). See here
• I confirm I am able to do a fresh clone of the repository and build the project on my local computer.

Which mobile framework are you using?

Flutter (Dart)

Steps to reproduce

I have a YAML-based Flutter setup, for macOS, Windows, Linux testing, and iOS builds.
(YAML at bottom)

The Windows test setup fails with a "Something went wrong" error.
The tests are running successfully, at least, the
flutter.json looks as expected. There's a few test failures but nothing unexpected / fatal on other platforms.

I have a feeling I'm just missing something simple about Windows paths...but I'm not sure.

I've tried downloading each of the build logs steps, as well as logging into the build machine and poking around files, but can't find anything to add more info to the "Build failed :| Something went wrong" error shown.

Error:

Directory: C:\Users\builder\clone


Mode                LastWriteTime         Length Name                                                                  
----                -------------         ------ ----                                                                  
d-----       12/21/2023   4:26 PM                test-results                                                          


Build failed :|
Something went wrong

YAML:

definitions:
  ...definitions unused by windows flow...
  instance_windows: &instance_windows
    instance_type: windows_x2 # https://docs.codemagic.io/yaml-basic-configuration/yaml-getting-started/#instance-type
    max_build_duration: 15
  env_versions: &env_versions
    flutter: stable
    xcode: latest
    cocoapods: default
  env_keys: &env_keys
    groups:
      - app
      - codecov
  ... more definitions unused by windows flow...
  script_build_runner_build: &script_build_runner_build
    name: Build runner build
    script: flutter pub run build_runner build --delete-conflicting-outputs
  script_pub_get: &script_pub_get
    name: flutter pub get
    script: flutter pub get
  script_run_tests_windows: &script_run_tests_windows
    name: Tests
    script: |
      mkdir -p test-results
      flutter test --coverage --machine > test-results\flutter.json
    test_report: test-results\flutter.json
  flutter_test_artifacts_windows: &flutter_test_artifacts_windows
    - C:\Users\builder\clone\test-results\flutter.json
   
workflows:
... other workflows
  windows-test:
    name: Windows Test
    <<: *instance_windows
    environment:
      <<: *env_versions
      <<: *env_keys
    scripts:
      - <<: *script_build_runner_build
      - <<: *script_run_tests_windows
    artifacts: *flutter_test_artifacts_windows

Expected results

Codemagic run completes. File with test results is attached. Tests step shows test failures.

Actual results

Codemagic run completes. File with test results is attached. Tests step shows "Build failed :| Something went wrong"

Build id (optional)

6584647c8d3ead7900c8e3ea

[Moeed366]

Use debugging tools to identify the specific reason for test failures. You can run tests with the --verbose flag to get more detailed output.
flutter test --verbose

[jpohhhh]

I tried adding --verbose to the run but got the same outcome. Build ID: 658716f797ada2a669d88921

I believe the tests aren't related:

• test logs show a ~successful run
• the actual error occurs on "Cleaning up" (last step in workflow, not written by me)
• the error is very different than standard ones, there's no description, and nothing in logs

[icarusdust]

FYI @jpohhhh it is not failing at the cleaning up step but when the integration test command is being executed. Thanks for providing a build id.I will look into it and get back to you asap.

[icarusdust]

I am snoozing this thread for now @jpohhhh, as soon as I have updates, I will reopen it by replying to you.