Datasource not responding using org.testcontainers:postgresql in 1.18.3 (works in 1.17.3)

[Mahoney]

Hi,

I'm starting up a Hikari datasource with a jdbc url of jdbc:tc:prebuiltdb:prebuilt_db:///test (prebuiltdb:prebuilt_db is an image we build from postgres:15.2-alpine3.17 with migrations pre-applied).

With version 1.17.3 it works fine, but with 1.18.3 the container starts OK but the JVM can't connect to it - times out.

Any ideas what's changed?

Hikari startup:

val dataSource = HikariDataSource().apply {
    this.jdbcUrl = "jdbc:tc:prebuiltdb:prebuilt_db:///test"
    this.username = "test"
    this.password = null
    maximumPoolSize = 15
    maxLifetime = Duration.ofMinutes(10).toMillis()
    keepaliveTime = Duration.ofMinutes(1).toMillis()
    this.connectionTimeout = Duration.ofMinutes(1).toMillis()
    initializationFailTimeout = -1 // decouple app startup from db being there
    isAutoCommit = true
    addDataSourceProperty("ssl", true)
    addDataSourceProperty("sslfactory", "org.postgresql.ssl.NonValidatingFactory")
    addDataSourceProperty("sslhostnameverifier", "org.apache.http.conn.ssl.NoopHostnameVerifier")
}

Logs:

INFO  [2023-06-05 11:19:22,858] req= com.zaxxer.hikari.HikariDataSource: HikariPool-1 - Starting...
INFO  [2023-06-05 11:19:22,869] req= com.zaxxer.hikari.HikariDataSource: HikariPool-1 - Start completed.
INFO  [2023-06-05 11:19:22,894] req= org.testcontainers.utility.ImageNameSubstitutor: Image name substitution will be performed by: DefaultImageNameSubstitutor (composite of 'ConfigurationFileImageNameSubstitutor' and 'PrefixingImageNameSubstitutor')
INFO  [2023-06-05 11:19:23,012] req= org.testcontainers.dockerclient.DockerClientProviderStrategy: Loaded org.testcontainers.dockerclient.UnixSocketClientProviderStrategy from ~/.testcontainers.properties, will try it first
INFO  [2023-06-05 11:19:23,161] req= org.testcontainers.dockerclient.DockerClientProviderStrategy: Found Docker environment with local Unix socket (unix:///var/run/docker.sock)
INFO  [2023-06-05 11:19:23,162] req= org.testcontainers.DockerClientFactory: Docker host IP address is localhost
INFO  [2023-06-05 11:19:23,174] req= org.testcontainers.DockerClientFactory: Connected to docker: 
  Server Version: 24.0.2
  API Version: 1.43
  Operating System: Docker Desktop
  Total Memory: 32058 MB
INFO  [2023-06-05 11:19:23,227] req= tc.testcontainers/ryuk:0.5.1: Creating container for image: testcontainers/ryuk:0.5.1
INFO  [2023-06-05 11:19:23,428] req= tc.testcontainers/ryuk:0.5.1: Container testcontainers/ryuk:0.5.1 is starting: f47e4487ff7ed270c76a5cce31dfd6c018354a6a7b29c20561c44b34cf2cd032
INFO  [2023-06-05 11:19:23,688] req= tc.testcontainers/ryuk:0.5.1: Container testcontainers/ryuk:0.5.1 started in PT0.508495S
INFO  [2023-06-05 11:19:23,692] req= org.testcontainers.utility.RyukResourceReaper: Ryuk started - will monitor and terminate Testcontainers containers on JVM exit
INFO  [2023-06-05 11:19:23,692] req= org.testcontainers.DockerClientFactory: Checking the system...
INFO  [2023-06-05 11:19:23,693] req= org.testcontainers.DockerClientFactory: ✔︎ Docker server version should be at least 1.6.0
INFO  [2023-06-05 11:19:23,693] req= tc.postgres:prebuilt_db: Creating container for image: postgres:prebuilt_db
INFO  [2023-06-05 11:19:23,718] req= tc.postgres:prebuilt_db: Container postgres:prebuilt_db is starting: b730375705579574224f9a1a72b43fac2e8c5e3fc997be0ae8119258c4586000
INFO  [2023-06-05 11:19:23,975] req= tc.postgres:prebuilt_db: Container postgres:prebuilt_db started in PT0.282692S
INFO  [2023-06-05 11:19:23,976] req= tc.postgres:prebuilt_db: Container is started (JDBC URL: jdbc:postgresql://localhost:53701/test?loggerLevel=OFF)
ERROR  [2023-06-05 11:19:27,877] req= Connection unavailable
! java.sql.SQLTransientConnectionException: HikariPool-1 - Connection is not available, request timed out after 60003ms.
! at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
! at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:197)
! at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:162)
! at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:128)
! at org.jooq.impl.DataSourceConnectionProvider.acquire(DataSourceConnectionProvider.java:87)
! ... 61 common frames omitted
! Causing: org.jooq.exception.DataAccessException: Error getting connection from data source HikariDataSource (HikariPool-1)
! at org.jooq_3.18.2.POSTGRES.debug(Unknown Source)
! at org.jooq.impl.DataSourceConnectionProvider.acquire(DataSourceConnectionProvider.java:90)
! at org.jooq.impl.DefaultExecuteContext.connection(DefaultExecuteContext.java:620)
! at org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:308)
! at org.jooq.impl.AbstractResultQuery.fetchLazy(AbstractResultQuery.java:301)
! at org.jooq.impl.AbstractResultQuery.fetchLazyNonAutoClosing(AbstractResultQuery.java:322)
! at org.jooq.impl.SelectImpl.fetchLazyNonAutoClosing(SelectImpl.java:2862)
! at org.jooq.impl.ResultQueryTrait.fetchOne(ResultQueryTrait.java:509)

[eddumelendez]

AFAIK, postgres default image doesn't bring ssl enabled and previous to 1.17.4 the properties in the datasource were ignored. See #5829

addDataSourceProperty("ssl", true) is adding the property to the testcontainers connection string? If so, a quick test is setting ssl to false and the proper one is to configure postgres image to require ssl

[Mahoney]

Aagh! And I've actually been caught by that previously and had forgotten... thanks.