No upload to AppStore - no errors, the build looks successful

[proshin-roman]

Summary

I have a build configuration (codemagic.yaml) for uploading my application to the AppStore. Even though the logs for builds look successful - there are no errors - I don't get any upload to the AppStore. So, it's still only the version I've uploaded manually.

The build script is built taking two CodeMagic articles as examples:

• https://docs.codemagic.io/yaml-quick-start/building-a-flutter-app/
• https://docs.codemagic.io/yaml-publishing/app-store-connect/

I'm pretty sure I'm missing something, but I'm really confused by seeing literally no errors in the build logs.

How should I modify the build script to get the artifact uploaded to the AppStore?

Any help/questions/advices are really welcomed!

Details

Here is the full codemagic.yaml (erased sensitive info):

workflows:
  build-ios-on-master:
    name: Build iOS on commit to master
    max_build_duration: 60
    integrations:
      app_store_connect: "<app-store-connect-ID>"
    environment:
      flutter: stable
      xcode: latest
      cocoapods: default
      ios_signing:
        distribution_type: app_store
        bundle_identifier: org.domain.package
      vars:
        APP_ID: xxx
    triggering:
      events:
        - push
      branch_patterns:
        - pattern: 'master'
          include: true
          source: true
    scripts:
      - name: Set up code signing settings on Xcode project
        script: |
          xcode-project use-profiles
      - name: Get Flutter packages
        script: |
          flutter pub get
      - name: Build the API client
        script: |
          flutter pub run build_runner build --delete-conflicting-outputs
      - name: Install pods
        script: |
          find . -name "Podfile" -execdir pod install \;
      - name: Flutter build ipa
        script: |
          BUILD_NUMBER=$(($(app-store-connect get-latest-app-store-build-number "$APP_ID") + 1))
          flutter build ipa --release \
            --build-name=1.0.$BUILD_NUMBER \
            --build-number=$BUILD_NUMBER \
            --export-options-plist=/Users/builder/export_options.plist
    artifacts:
      - build/ios/ipa/*.ipa
      - /tmp/xcodebuild_logs/*.log
      - flutter_drive.log
integrations:
  app_store_connect: "<app-store-connect-ID>"
publishing:
  app_store_connect:
    auth: integration
    submit_to_testflight: true
    expire_build_submitted_for_review: true
    beta_groups:
      - "Family & friends"
    submit_to_app_store: false
    cancel_previous_submissions: true
    release_type: MANUAL
    copyright: 2023 xxx

For the last build, I've got the following logs:
Step "Flutter build ipa":

Did not find latest build for app xxx

Archiving org.domain.package...
Adding input path to Thin Binary build phase.
Automatically signing iOS for device deployment using specified development team in Xcode project: XXXX
Running pod install...                                             850ms
Running Xcode build...                                          
Xcode archive done.                                         61.3s
Built /Users/builder/clone/build/ios/archive/Runner.xcarchive.

[✓] App Settings Validation
    • Version Number: 1.0.2
    • Build Number: 2
    • Display Name: App Name
    • Deployment Target: 11.0
    • Bundle Identifier: org.domain.package

[!] App Icon and Launch Image Assets Validation
    ! App icon is set to the default placeholder icon. Replace with unique icons.
    ! Launch image is set to the default placeholder icon. Replace with unique launch image.

To update the settings, please refer to https://docs.flutter.dev/deployment/ios

Building App Store IPA...                                           9.8s
Built IPA to /Users/builder/clone/build/ios/ipa.
To upload to the App Store either:
    1. Drag and drop the "build/ios/ipa/*.ipa" bundle into the Apple Transporter macOS app https://apps.apple.com/us/app/transporter/id1234567
    2. Run "xcrun altool --upload-app --type ios -f build/ios/ipa/*.ipa --apiKey your_api_key --apiIssuer your_issuer_id".
       See "man altool" for details about how to authenticate with the App Store Connect API key.

Step "Publishing":

== Gathering artifacts ==

== Publishing artifacts ==

Publishing artifact app_name.ipa

For the last step "Cleaning up":

Dependency caching is disabled. Skipping.

[himesh-cm]

Hi @proshin-roman, can you please share a build id as well?

[proshin-roman]

@himesh-cm I've tried the fix you proposed, as well I've tried to first upload another app version manually and then trigger another build - still no luck to get it working.
Another weird thing I've noticed is that I always get that message Did not find latest build for app - I guess this might also be a sign that something is not working as expected...

[himesh-cm]

Is the app id correct? Can you please check to be double sure?
Please check the var APP_ID

[proshin-roman]

@himesh-cm I've checked the app ID: APP_ID variable is set to the same value as I see in the "App Information > Apple ID" section on the App Store Connect.

But dear God, I've noticed that the whole publishing section was on the root level of the YAML file. So, I've fixed that, and now I'm at least getting further - build 6481d849e362a30a73d6f053 has failed because of the version duplicate: since the build cannot retrieve the version from the AppStore, it defaults to 1.0.1 that already exists, hence uploading of the artifact fails.

So, it looks like once I fix that issue with retrieving the latest version, the whole setup is gonna start working as expected 👍

I'm trying to re-establish the whole connection between CodeMagic and AppStore now to see if it can fix the issue...

[proshin-roman]

@himesh-cm finally, I was able to get a successful build as well as a successful upload to the AppStore. The issues were - as usually - sitting in front of the monitor :D I mean, that was me who was ignoring obvious things in the build script - just because I copy-pasted things from the official tutorial and thought it's gonna work without any additional work. I hope we can save some time for other people who might face the same issues as well (even though these errors look like obvious to fix).

Issue 1

I would improve a code snippet in the "Setting up publishing to App Store Connect / Distribution to App Store Connect" section on the https://docs.codemagic.io/yaml-publishing/app-store-connect/#setting-up-publishing-to-app-store-connect page. In particular, the issue for me was that the code snippet left me under the impression that integrations: section must be on the root level, and when I blindly copied it to my config, there was nothing that would signal me I'm doing something wrong. Having either a proper indentation in the code block itself, or a note that this block must be a part of the "workflow" would already save me some time since I noticed this problem absolutely randomly. Also, a proper scheme definition could also help me, but it seems I already have it in my IntelliJ IDEA since other syntax errors are highlighted and still that integrations: on the root level was looking valid config.

Issue 2

Page https://docs.codemagic.io/yaml-quick-start/building-a-flutter-app/#build-versioning, section "Build versioning", tab "iOS". The code snippet defines a script that retrieves the latest App Store version from the App Store:

BUILD_NUMBER=$(($(app-store-connect get-latest-app-store-build-number "$APP_ID") + 1))

I'm talking about that get-latest-app-store-build-number command.
And again that was me who blindly copied this script to my config file and expected it to work correctly, even though I'm currently at the testing phase, when the application I'm trying to publish is not even published to the (public) App Store. Hence, this command obviously returns nothing :) And then I found this nicely written documentation for these commands https://github.com/codemagic-ci-cd/cli-tools/blob/master/docs/app-store-connect/get-latest-build-number.md when it became obviously to me, that I have to use get-latest-build-number command so that I get any latest version. Once I fixed that, everything started working!!! So, here I would also recommend to somehow note that important difference somewhere near the code snippet on the documentation page - might save time for beginners who also first publishes apps to the "Test Flight".

Now, I mark my issue as resolved, and hope the text above makes CodeMagic even better 👍

Thank you @himesh-cm for your support!

[himesh-cm]

Hi @proshin-roman, Thank you for the detailed response; we will look into the documentation suggestion as pointed out by you.