Docker API version is incorrectly reported when '/_ping` calls fail and version should be fixed

[dbaltor]

mvn spring-boot:build-image -Dspring-boot.build-image.imageName="$FULL_IMAGE_NAME" -DskipTests fails in Bitbucket Pipeline with the following error message:

[ERROR] Failed to execute goal org.springframework.boot:spring-boot-maven-plugin:3.4.0:build-image (default-cli) on project PROJECT-NAME: Execution default-cli of goal org.springframework.boot:spring-boot-maven-plugin:3.4.0:build-image failed: Docker API version must be at least 1.41 to support the 'imagePlatform' option, but current API version is 1.24 

It works fine with Spring Boot 3.3.6.

Spring Boot 3.4.0
Bitbucket step image: maven:3.9.5-amazoncorretto-21-al2023

Maven configuration:

            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
                <executions>
                    <execution>
                        <goals>
                            <goal>build-info</goal>
                        </goals>
                    </execution>
                </executions>
                <configuration>
                    <excludes>
                        <exclude>
                            <groupId>org.projectlombok</groupId>
                            <artifactId>lombok</artifactId>
                        </exclude>
                    </excludes>
                    <!-- CONFIG TO RUN BUILDPACKS IN BITBUCKET - begin -->
                    <!-- https://github.com/spring-projects/spring-boot/issues/28387 -->
                    <docker>
                        <bindHostToBuilder>true</bindHostToBuilder>
                    </docker>
                    <image>
                        <env>
                            <BP_JVM_VERSION>${java.version}</BP_JVM_VERSION>
                        </env>
                        <securityOptions/>
                        <buildWorkspace>
                            <bind>
                                <source>/opt/atlassian/pipelines/agent/build/cache-${project.artifactId}.work</source>
                            </bind>
                        </buildWorkspace>
                        <buildCache>
                            <bind>
                                <source>/opt/atlassian/pipelines/agent/build/cache-${project.artifactId}.build</source>
                            </bind>
                        </buildCache>
                        <launchCache>
                            <bind>
                                <source>/opt/atlassian/pipelines/agent/build/cache-${project.artifactId}.launch</source>
                            </bind>
                        </launchCache>
                    </image>
                    <!-- CONFIG TO RUN BUILDPACKS IN BITBUCKET - end -->
                </configuration>
            </plugin>

It might be related to #19945

[vonZeppelin]

This will be fixed in 3.4.1 #43424

[philwebb]

Thanks @vonZeppelin. @dbaltor, feel free to give the SNAPSHOT a go and provide feedback if you want to test the fix.

[dbaltor]

Thanks @philwebb and @vonZeppelin. I've tested the snapshot and I'm afraid it doesn't work either. I've got the same error message after upgrading to the latest SNAPSHOT:

[ERROR] Failed to execute goal org.springframework.boot:spring-boot-maven-plugin:3.4.1-SNAPSHOT:build-image (default-cli) on project PROJECT-NAME: Execution default-cli of goal org.springframework.boot:spring-boot-maven-plugin:3.4.1-SNAPSHOT:build-image failed: Docker API version must be at least 1.41 to support the 'imagePlatform' option, but current API version is 1.24 -> [Help 1]

AS per the error message above and this comment #28387 (comment), it looks like Spring Boot started using a Docker API version not available in Bitbucket pipelines to build the container image.

Is there anything the Spring team might be able to do to solve this?

[philwebb]

I think we depend on newer APIs so we can't easily lower the baseline I'm afraid.

[dbaltor]

Thanks @philwebb. I'd like to pick your brain (as well as anybody else's reading this) to try understanding what might be happening.

Atlassian upgraded BB to use Docker Engine 25 at the beginning of this year. Here's the output of docker version within the pipeline step :

Client:
 Version:           20.10.24
 API version:       1.41
 Go version:        go1.19.7
 Git commit:        297e128
 Built:             Tue Apr  4 18:17:06 2023
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true
Server: Docker Engine - Community
 Engine:
  Version:          25.0.3
  API version:      1.44 (minimum version 1.24)
  Go version:       go1.21.6
  Git commit:       f417435
  Built:            Fri Feb 23 02:38:33 2024
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          v1.7.13
  GitCommit:        7c3aca7a610df76212171d200ca3811ff6096eb8
 runc:
  Version:          1.1.12
  GitCommit:        v1.1.12-0-g51d5e94
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

I don't know where the docker API 1.24 is coming from. 🤷‍♂️

[philwebb]

Actually, looking again I wonder if our fix in #43424 is correct. If we don't get a reply, we return the minimum version.

[philwebb]

I can't reopen the #43424 because the branch is gone. We'll use this one to fix it.