CLOUDP-295785 - release tasks integration with `atomic_pipeline.py` #344

MaciejKaras · 2025-08-13T13:28:42Z

Summary

Created new .evergreen-release.yml file that contains all release tasks including integration with kubectl-mongodb plugin release task. All of the variants are triggered only when github_tag is added.

Additional changes:

removed unused inventory .yaml files. We moved all of the images besides om and agent-pct used during OM bump to new atomic_pipeline.py.
each released image will be also released with additional olm_tag that has dynamic timestamp part. It will prevent accidental overriding the tags used by OLM. The tag syntax is {version}-olm-{timestamp_suffix} where timestamp suffix is in %Y%m%d%H%M%S format
created separate release_pipeline evergreen function that uses release build scenario and version provided by git_tag

Proof of Work

List of tasks that are triggered when doing manual patch:

⚠️ This PR did not test that each release task will succeed. Although most of the tasks are moved from one place to another, we need to make sure that for example image building, tagging and pushing works.

Checklist

Have you linked a jira ticket and/or is the ticket in the title?
Have you checked whether your jira ticket required DOCSP changes?
Have you added changelog file?
- use skip-changelog label if not needed
- refer to Changelog files and Release Notes section in CONTRIBUTING.md for more details

Fix build scenario Remove create and push manifests Continue improvement to main Simplify main and build_context missed Pass Build Configuration object directly Use legacy and new pipeline Fix Remove --include Rename MCO test image Multi platform builds, with buildx TODOs Implement is_release_step_executed() Fix init appdb image Import sort black formatting Some cleaning and version adjustments Adapt main to new build config Add buildscenario to buildconfig Handle build env Renaming, usage of high level config All images build pass on EVG Lint Explicit image type, support custom build_path Replace old by new pipeline in EVG Add documentation Split in multiple files, cleanup WIP, passing builds on staging temp + multi arch manifests Replace usage of sonar Remove namespace Remove pin_at and build_id Copied pipeline, removed daily builds and --exclude

This reverts commit 426e522.

# Conflicts: # scripts/release/atomic_pipeline.py # scripts/release/build/build_info.py # scripts/release/build/build_info_test.py

github-actions · 2025-08-13T13:29:28Z

⚠️ (this preview might not be accurate if the PR is not rebased on current master branch)

MCK 1.3.0 Release Notes

New Features

Multi-Architecture Support

We've added comprehensive multi-architecture support for the kubernetes operator. This enhancement enables deployment on IBM Power (ppc64le) and IBM Z (s390x) architectures alongside
existing x86_64 support. Core images (operator, agent, init containers, database, readiness probe) now support multiple architectures. We do not add support IBM and ARM support for Ops-Manager and the init-ops-manager image.

MongoDB Agent images have been migrated to new container repository: quay.io/mongodb/mongodb-agent.
- the agents in the new repository will support the x86-64, ARM64, s390x, and ppc64le architectures. More can be read in the public docs.
- operator running >=MCK1.3.0 and static cannot use the agent images from the old container repository quay.io/mongodb/mongodb-agent-ubi.
quay.io/mongodb/mongodb-agent-ubi should not be used anymore, it's only there for backwards compatibility.

Bug Fixes

This change fixes the current complex and difficult-to-maintain architecture for stateful set containers, which relies on an "agent matrix" to map operator and agent versions which led to a sheer amount of images.
We solve this by shifting to a 3-container setup. This new design eliminates the need for the operator-version/agent-version matrix by adding one additional container containing all required binaries. This architecture maps to what we already do with the mongodb-database container.
Fixed an issue where the readiness probe reported the node as ready even when its authentication mechanism was not in sync with the other nodes, potentially causing premature restarts.

Other Changes

Optional permissions for PersistentVolumeClaim moved to a separate role. When managing the operator with Helm it is possible to disable permissions for PersistentVolumeClaim resources by setting operator.enablePVCResize value to false (true by default). When enabled, previously these permissions were part of the primary operator role. With this change, permissions have a separate role.
subresourceEnabled Helm value was removed. This setting used to be true by default and made it possible to exclude subresource permissions from the operator role by specifying false as the value. We are removing this configuration option, making the operator roles always have subresource permissions. This setting was introduced as a temporary solution for this OpenShift issue. The issue has since been resolved and the setting is no longer needed.
We have deliberately not published the container images for OpsManager versions 7.0.16, 8.0.8, 8.0.9 and 8.0.10 due to a bug in the OpsManager which prevents MCK customers to upgrade their OpsManager deployments to those versions.

# Conflicts: # scripts/release/tests/build_info_test.py

nammn · 2025-08-14T15:56:57Z

.evergreen-release.yml

+include:
+  - filename: .evergreen-functions.yml
+
+tasks:


we should consider whether we want to migrate om and agent (independent release lifecycle) into this file or another independent file

I also thought about that, but first I wanted to tackle operator release tasks.

nammn · 2025-08-18T13:59:58Z

.evergreen-functions.yml

-        binary: scripts/dev/run_python.sh scripts/release/pipeline_main.py --parallel ${image_name}
+        env:
+          git_tag: ${triggered_by_git_tag}
+        binary: scripts/dev/run_python.sh scripts/release/pipeline_main.py ${image_name} --build-scenario release --version ${git_tag}


this won't work for om and agent, we should add support for these as well - otherwise we will be living in a limbo of requiring supporting both

@nammn I think you've already moved om and agent into the new pipeline, right?

# Conflicts: # build_info.json # scripts/dev/contexts/e2e_mdb_kind_ubi_cloudqa # scripts/dev/contexts/e2e_static_mdb_kind_ubi_cloudqa # scripts/dev/contexts/local-defaults-context # scripts/dev/contexts/variables/om60 # scripts/release/atomic_pipeline.py # scripts/release/build/image_build_configuration.py # scripts/release/build/image_build_process.py # scripts/release/pipeline_main.py # scripts/release/tests/build_info_test.py # scripts/release/tests/release_info_test.py

Julien-Ben added 30 commits July 29, 2025 17:30

Remove file

675bee4

Put lib back in dependencies

833e25f

add todo

15e7f51

Fix

120c1af

Remove multi arch call, fix test image path

c9ceabf

Fix agent version for default case

fb87f4d

Lindt

c05e180

isort

747c4ba

Cleanup TODOs

03fd9b8

Rename arch -> platform

1fbb8d5

Don't rely on exception to check for builder existence

e9a524f

Remove unused variables

fa6b899

Pre commit

426e522

Cleanup

6890858

Correct build envs

aab9592

Lindt

33173bb

Update Makefile

74e867c

Add TODO

b13b054

Revert "Pre commit"

832ce61

This reverts commit 426e522.

Remove agent unused functions

bc23827

Remove debug

03062c3

Remove args iteration for multi platform

4d4e4e9

Cleanup unused stuff

7c9967a

Cleanup

a7c63c9

Rename file

742e784

Remove cli sbom

1f0a21b

Renamed image building file

813d539

Freeze python on whales

c06061b

Lint

5f9d49a

MaciejKaras added 2 commits August 13, 2025 12:20

Update OM6 agent version (previous was deleted)

2a0438c

Merge branch 'master' into maciejk/ar-image-staging

ee7d8ad

# Conflicts: # scripts/release/atomic_pipeline.py # scripts/release/build/build_info.py # scripts/release/build/build_info_test.py

MaciejKaras changed the base branch from master to maciejk/ar-image-staging August 13, 2025 13:29

MaciejKaras added the skip-changelog Use this label in Pull Request to not require new changelog entry file label Aug 13, 2025

MaciejKaras marked this pull request as ready for review August 13, 2025 13:44

MaciejKaras requested a review from a team as a code owner August 13, 2025 13:44

MaciejKaras requested review from fealebenpae, m1kola, nammn, viveksinghggits, Julien-Ben and mircea-cosbuc and removed request for a team, fealebenpae and m1kola August 13, 2025 13:44

MaciejKaras added 4 commits August 13, 2025 16:32

Remove TODO for STAGING build scenario

c8945e9

Add commit_sha in logger

51a554d

Remove STAGING overrides

92bbd95

Merge branch 'master' into maciejk/ar-image-staging

18582c7

# Conflicts: # scripts/release/tests/build_info_test.py

nammn reviewed Aug 14, 2025

View reviewed changes

nammn mentioned this pull request Aug 14, 2025

CLOUDP-338084 - removing and refactoring agent matrix from pipeline.py and atomic_pipeline.py #346

Merged

3 tasks

nammn reviewed Aug 18, 2025

View reviewed changes

MaciejKaras added 3 commits September 1, 2025 14:57

fixes

1801c66

CLOUDP-295785 - Release tasks reorg to use new atomic_pipeline

9ced848

MaciejKaras force-pushed the maciejk/ar-image-release branch from 93648fd to 9ced848 Compare September 1, 2025 14:32

MaciejKaras changed the base branch from maciejk/ar-image-staging to master September 1, 2025 14:32

Fixes + remove old pipeline and sonar

1f0f78d

MaciejKaras force-pushed the maciejk/ar-image-release branch from 1f997c8 to 1f0f78d Compare September 1, 2025 15:24

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

CLOUDP-295785 - release tasks integration with `atomic_pipeline.py` #344

CLOUDP-295785 - release tasks integration with `atomic_pipeline.py` #344

Uh oh!

MaciejKaras commented Aug 13, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Aug 13, 2025 •

edited

Loading

Uh oh!

nammn Aug 14, 2025

Uh oh!

MaciejKaras Sep 1, 2025

Uh oh!

nammn Aug 18, 2025

Uh oh!

MaciejKaras Sep 1, 2025

Uh oh!

Uh oh!

CLOUDP-295785 - release tasks integration with atomic_pipeline.py #344

Are you sure you want to change the base?

CLOUDP-295785 - release tasks integration with atomic_pipeline.py #344

Uh oh!

Conversation

MaciejKaras commented Aug 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Proof of Work

Checklist

Uh oh!

github-actions bot commented Aug 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

MCK 1.3.0 Release Notes

New Features

Multi-Architecture Support

Bug Fixes

Other Changes

Uh oh!

nammn Aug 14, 2025

Choose a reason for hiding this comment

Uh oh!

MaciejKaras Sep 1, 2025

Choose a reason for hiding this comment

Uh oh!

nammn Aug 18, 2025

Choose a reason for hiding this comment

Uh oh!

MaciejKaras Sep 1, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

CLOUDP-295785 - release tasks integration with `atomic_pipeline.py` #344

CLOUDP-295785 - release tasks integration with `atomic_pipeline.py` #344

MaciejKaras commented Aug 13, 2025 •

edited

Loading

github-actions bot commented Aug 13, 2025 •

edited

Loading