Code Push deploys are failing with a server error in about 5% of times

[zubko]

If you are looking for help, please confirm the following...

• I confirm I have searched the Docs, Codemagic Sample Projects, and GitHub Discussions.
• I confirm the software versions on my local computer match the ones in CI environment (e.g. Xcode version, Gradle version). See here
• I confirm I am able to do a fresh clone of the repository and build the project on my local computer.

Which mobile framework are you using?

React Native

Steps to reproduce

We use the Code Push CLI from this guide https://docs.codemagic.io/integrations/codepush-integration/

We call it like

code-push-standalone release-react "%%app-name%%" android --description "%%description%%" -d "Production" -t 57.0.0 --noDuplicateReleaseError --sourcemapOutput "index.android.bundle.map" -o "cpush-output" --useHermes

Most of times it works fine, but sometimes we get:

...
private key was not provided
Releasing update contents to CodePush:
[Error]  Internal Server Error

The command fails, but on immediate restart it goes successful.

I see this line private key was not provided on the successful uploads as well. So I don't think it's related, but include it just in case.

Expected results

The Code Push bundle upload works in 100% of times

Actual results

The Code Push bundle upload fails from time to time

Build id (optional)

No response

[mikhail-tokarev]

Hi @zubko
any chance you can provide timestamps when it happened last time? I'm going to check logs to see if I find more details

[zubko]

@mikhail-tokarev

One has failed today around 30 mins ago

So around:
2025-03-27T15:27:36Z

more or less

[mikhail-tokarev]

I was able to find the error in the logs and it looks like this method returns undefined in some cases (the method used from here)

will see if I can find something more about this problem

error log

2025-03-27T15:28:59.942086329Z Processing package: v16
2025-03-27T15:28:59.944950834Z Unknown error source
2025-03-27T15:28:59.944959790Z TypeError [ERR_INVALID_ARG_TYPE]: The "path" argument must be of type string or an instance of Buffer or URL. Received undefined
2025-03-27T15:28:59.944962334Z     at Object.mkdirSync (node:fs:1384:10)
2025-03-27T15:28:59.944964334Z     at PackageDiffer.ensureWorkDirectoryExists (/app/bin/script/utils/package-diffing.js:297:20)

[zubko]

Thanks @mikhail-tokarev - great debugging skills :)

It's strange that TMP is not in the env sometimes. Can it be something with the infra on which you run the server?

Or do you think it's with the server itself? Did you report it in the Code Push repo?

As of today, this is still happening.

For now we are going to add one automatic retry at least.

[mikhail-tokarev]

sorry it got lost...

there is a PR for this issue. We are going to try it soon and see if it helps

[mikhail-tokarev]

hey @zubko
we've deployed the changes today. Please let us know if the issue still persists for you

[zubko]

Hi @mikhail-tokarev ,
Thanks for merging the fix and for letting me know.
We had actually a bigger issue which I didn’t have time to investigate and post but somehow a bundle for one our app appeared in the place of another app 🤯. We have a family of apps built from the same codebase but for different countries and we deployed them all together from parallel containers on our CI. But I think CodePush server has some issues with parallel uploads from one account. Maybe some global cache by userId or something. So it appeared to be super dangerous to upload in parallel and we switched to sequential uploads. Now it takes much more time, but I have not seen both of these errors in a while 🤞
That’s why I cannot test and verify that this particular issue with server error is gone now.
But I am sure it will help other people who upload a number of apps at the same time.

[mikhail-tokarev]

did you use the same deployment key in parallel uploads? anyway it will be helpful if you file a new issue and some steps to reproduce, so we can try to investigate it too

[zubko]

Yup, the same key.
Try to make like 8 RN apps from the same account / key and build them all in parallel from different containers using the same codebase so the build time will be very similar. For one app we build / deploy first for Android and then for iOS in the same container, if that matters.
Everything was fine for long time so the chance to hit this issue is not that high. But maybe you’ll be lucky.

[icarusdust]

So far no luck with reproducing it @zubko, we'll continue the investigation.

As the original issue seems to be fixed with the deployment above, I'll close this discussion thread, so we can continue either in a new thread or here, once it can be reproduced.