fix!: default composer image version

[alexis974]

BEGIN_COMMIT_OVERRIDE
fix!: default composer image version
END_COMMIT_OVERRIDE

The current default composer image is not supported anymore on gcp

[google-cla]

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

[imrannayer]

@alexis974 can u plz follow this guide to fix lint issue.

[alexis974]

Hello @imrannayer, done !

[imrannayer]

/gcbrun

[nlevee]

I think it's not the valid image version, in composer v2, you need to use a v2.x image version

[alexis974]

It did work when I used image_version = "composer-3-airflow-2.10.2" with the create_environment_v2 module in version v5.2.0

If we check the Cloud composer version list we can see that for composer v3, minor and patch are not present in version name

[imrannayer]

/gcbrun

[imrannayer]

@alexis974 can u plz use image from composer 2? Integration test is failing with following error. We need to handle this exception for composer 3.

TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z command.go:185: Error: error in configuration, config.0.private_environment_config should not be used in Composer 3
TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z command.go:185: 
TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z command.go:185:   with module.simple-composer.module.simple-composer-environment.google_composer_environment.composer_env,
TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z command.go:185:   on ../../../modules/create_environment_v2/main.tf line 27, in resource "google_composer_environment" "composer_env":
TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z command.go:185:   27: resource "google_composer_environment" "composer_env" {
TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z command.go:185: 
TestSimpleComposerEnvV2Module 2025-01-10T13:21:42Z retry.go:99: Returning due to fatal error: FatalError{Underlying: error while running command: exit status 1; 
Error: error in configuration, config.0.private_environment_config should not be used in Composer 3

[alexis974]

Alright @imrannayer ,
I downgraded to the latest composer v2 version which is composer-2.10.2-airflow-2.10.2 as stated here.

Notice that it is supported until January 10, 2026

[imrannayer]

/gcbrun

[imrannayer]

@alexis974 integration test is failing. Can u plz comment this line?

terraform-google-composer/test/integration/composer_v2_sharedvpc_prereq/composer_v2_sharedvpc_prereq_test.go

Line 30 in 70e07a3

composer.DefaultVerify(assert)

[alexis974]

@alexis974 integration test is failing. Can u plz comment this line?

terraform-google-composer/test/integration/composer_v2_sharedvpc_prereq/composer_v2_sharedvpc_prereq_test.go

Line 30 in 70e07a3

composer.DefaultVerify(assert)

Done ! Could you run the workflow again ? @imrannayer

[imrannayer]

/gcbrun

[imrannayer]

/gcbrun