BUILD-7780: Use monthly cache for orchestrator

[jayadeep-km-sonarsource]

BUILD-7780

Part of https://sonarsource.atlassian.net/browse/BUILD-7780

This PR introduces caching of artifacts downloaded by orchestrator in the pipeline. It is necessary to reduce bandwidth consumption from repox.

[sonarqube-next]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

[Godin]

Looking at https://cirrus-ci.com/task/5138860197281792

Seems that cache is always reuploaded because it contains plugin whose build number changes with every build:

Cache orchestrator has changed!
List of changes for cache folders (/tmp/cirrus-ci-build/orchestrator/LATEST_RELEASE/March):
created: cache/6ed2bf71b59fdbfdb2a7588213dddc61/sonar-kotlin-plugin-3.1.0.6960.jar
orchestrator cache size is 1014Mb.
Uploading cache orchestrator...

And this task lacs execution of clean-orchestrator-cache.sh

[Godin]

@julien-carsique-sonarsource AFAICS in addition to sonar-application you're trying to preserve at least one sonar-kotlin-plugin in cache, but this means that cache will be uploaded every time sonar-kotlin-plugin build number changes ie every PR, which is ~40 seconds to transfer ~1GB. To avoid this and if we wanna avoid downloading sonar-kotlin-plugin from Repox, then we can simply pass it from task that produces it into task that consumes it - see for example https://github.com/SonarSource/sonar-cpp/blob/6.65.0.81949/.cirrus.yml#L371-L381 and https://github.com/SonarSource/sonar-dart/blob/1.1.0.2133/.cirrus.yml#L175
If you wanna you can leave this PR in a state when only sonar-application is cached, then I can take it over from there and add transfer of sonar-kotlin-plugin between tasks. Hope this helps.

[Godin]

@julien-carsique-sonarsource IMO this will also simplify script logic that you've been trying to debug.

[sonarqube-next]

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

[julien-carsique-sonarsource]

@Godin actually, I was fixing a Windows issue with interpreting the shell script.
It is now working as expected with keeping only the last version for sonar-application and no sonar-kotlin-plugin:

.cirrus/clean-orchestrator-cache.sh
File that will not be deleted:
./cache/5dd55d105f71c91a8572d3e3c7201bbd/sonar-application-25.3.0.104237.zip
Files that will be deleted:
./cache/8cb4c419cdd6d1dbff80e331d241b6cb/sonar-kotlin-plugin-3.1.0.7068.jar

That makes the cache efficient without the continuous update due to sonar-kotlin-plugin.

The suggested improvement, from task to task, will also save the Repox bandwidth and totally makes sense.
Yes, please, can you merge the current PR and take over it for the following improvements?

[Godin]

The suggested improvement, from task to task, will also save the Repox bandwidth and totally makes sense.
Yes, please, can you merge the current PR and take over it for the following improvements?

See #609

[Godin]

For the record part implemented here seems buggy

https://cirrus-ci.com/task/6105864098021376?logs=cleanup_orchestrator_cache#L0

.cirrus/clean-orchestrator-cache.sh
File that will not be deleted:
./cache/de6977a0463613ee1be7bdeff2bc18b9/sonar-application-25.5.0.106048.zip
Files that will be deleted:
./cache/8e5f056686be87b900e12b5467e97f70/sonar-application-25.5.0.106089.zip
./cache/970fbd85cdd43d384304a9dab63fb233/sonar-kotlin-plugin-3.2.0.7099.jar

removed sonar-application-25.5.0.106089.zip is newer than kept sonar-application-25.5.0.106048.zip