Implement Testcontainers proof of concept

Built working POC for replacing Makefile + Docker with Testcontainers:

Implementation:
- testcontainers_helper.go: Helper functions for starting MySQL containers
  using GenericContainer (compatible with Go 1.21)
- data_source_databases_testcontainers_test.go: Example test showing
  Testcontainers usage
- Uses build tag 'testcontainers' so old tests still work

Features:
- Automatic container lifecycle management
- Works with Docker and Podman (auto-detection)
- Sets environment variables automatically
- Cleanup on test completion
- Compatible with existing test infrastructure

Usage:
  go test -tags=testcontainers -v ./mysql/... -run TestAccDataSourceDatabases_WithTestcontainers

Dependencies:
- testcontainers-go v0.30.0 (compatible with Go 1.21)
- Uses GenericContainer instead of MySQL module for compatibility

This is a proof of concept - ready for testing and evaluation.

Author: zph

TESTCONTAINERS_POC.md

@@ -0,0 +1,108 @@
+# Testcontainers Proof of Concept
+
+This directory contains a proof of concept implementation using Testcontainers instead of the Makefile + Docker approach.
+
+## What's Implemented
+
+1. **`mysql/testcontainers_helper.go`**: Helper functions for starting MySQL containers
+2. **`mysql/data_source_databases_testcontainers_test.go`**: Example test using Testcontainers
+
+## How to Use
+
+### Prerequisites
+
+- Docker or Podman installed
+- Go 1.21+ (project requirement)
+
+### Running Tests
+
+```bash
+# Run the Testcontainers-based test
+go test -tags=testcontainers -v ./mysql/... -run TestAccDataSourceDatabases_WithTestcontainers
+
+# Run all tests (both old and new)
+go test -tags=testcontainers -v ./mysql/...
+```
+
+### With Podman
+
+Testcontainers automatically detects Podman. To use Podman explicitly:
+
+```bash
+# Set Podman socket (if needed)
+export CONTAINER_HOST=unix://$HOME/.local/share/containers/podman/machine/podman-machine-default/podman.sock
+
+# Run tests
+go test -tags=testcontainers -v ./mysql/... -run TestAccDataSourceDatabases_WithTestcontainers
+```
+
+## How It Works
+
+1. **Build Tag**: Code is gated behind `// +build testcontainers` tag
+   - Old tests continue to work without Testcontainers
+   - New tests only run when `-tags=testcontainers` is used
+
+2. **Container Lifecycle**: 
+   - Container starts automatically when test begins
+   - Environment variables are set for the test
+   - Container terminates automatically when test completes
+
+3. **Compatibility**: 
+   - Works with Docker (default)
+   - Works with Podman (automatic detection)
+   - Uses GenericContainer for Go 1.21 compatibility
+
+## Example Test
+
+```go
+func TestAccDataSourceDatabases_WithTestcontainers(t *testing.T) {
+    ctx := context.Background()
+    
+    // Start MySQL container
+    container := startMySQLContainer(ctx, t, "mysql:8.0")
+    defer container.SetupTestEnv(t)()
+    
+    // Run tests (same as before)
+    resource.Test(t, resource.TestCase{
+        PreCheck:          func() { testAccPreCheck(t) },
+        ProviderFactories: testAccProviderFactories,
+        Steps: []resource.TestStep{
+            // ... test steps
+        },
+    })
+}
+```
+
+## Benefits Over Makefile Approach
+
+1. **No Shell Scripts**: Pure Go code
+2. **Automatic Cleanup**: Containers terminate automatically
+3. **Better Error Messages**: Container logs captured on failure
+4. **Parallel Execution**: Go's testing framework handles parallelism
+5. **Podman Support**: Works without configuration changes
+
+## Next Steps
+
+1. **Test Locally**: Verify it works with your Docker/Podman setup
+2. **Measure Performance**: Compare startup time vs. Makefile approach
+3. **Convert More Tests**: Gradually migrate other test files
+4. **CI/CD Integration**: Update GitHub Actions to use Testcontainers
+
+## Troubleshooting
+
+### Container Won't Start
+
+- Check Docker/Podman is running: `docker ps` or `podman ps`
+- Check image exists: `docker images mysql:8.0`
+- Increase timeout in `testcontainers_helper.go` if needed
+
+### Port Conflicts
+
+- Testcontainers automatically assigns random ports
+- No manual port calculation needed (unlike Makefile approach)
+
+### Podman Issues
+
+- Ensure Podman socket is accessible
+- Check `CONTAINER_HOST` environment variable if needed
+- Testcontainers should auto-detect Podman

go.mod

@@ -10,6 +10,8 @@ require (
 	github.com/hashicorp/go-version v1.7.0
 	github.com/hashicorp/terraform-plugin-log v0.9.0
 	github.com/hashicorp/terraform-plugin-sdk/v2 v2.34.0
+	github.com/testcontainers/testcontainers-go v0.30.0
+	github.com/testcontainers/testcontainers-go/modules/mysql v0.30.0
 	github.com/tidwall/gjson v1.17.1
 	golang.org/x/net v0.26.0
 	golang.org/x/oauth2 v0.21.0
@@ -20,17 +22,31 @@ require (
 	cloud.google.com/go/auth v0.5.1 // indirect
 	cloud.google.com/go/auth/oauth2adapt v0.2.2 // indirect
 	cloud.google.com/go/compute/metadata v0.3.0 // indirect
+	dario.cat/mergo v1.0.0 // indirect
 	filippo.io/edwards25519 v1.1.0 // indirect
 	github.com/Azure/azure-sdk-for-go/sdk/internal v1.9.0 // indirect
+	github.com/Azure/go-ansiterm v0.0.0-20210617225240-d185dfc1b5a1 // indirect
 	github.com/AzureAD/microsoft-authentication-library-for-go v1.2.2 // indirect
+	github.com/Microsoft/go-winio v0.6.1 // indirect
+	github.com/Microsoft/hcsshim v0.11.4 // indirect
 	github.com/ProtonMail/go-crypto v1.1.0-alpha.2-proton // indirect
 	github.com/agext/levenshtein v1.2.3 // indirect
 	github.com/apparentlymart/go-textseg/v15 v15.0.0 // indirect
+	github.com/cenkalti/backoff/v4 v4.2.1 // indirect
 	github.com/cloudflare/circl v1.3.8 // indirect
+	github.com/containerd/containerd v1.7.12 // indirect
+	github.com/containerd/log v0.1.0 // indirect
+	github.com/cpuguy83/dockercfg v0.3.1 // indirect
+	github.com/distribution/reference v0.5.0 // indirect
+	github.com/docker/docker v25.0.5+incompatible // indirect
+	github.com/docker/go-connections v0.5.0 // indirect
+	github.com/docker/go-units v0.5.0 // indirect
 	github.com/fatih/color v1.17.0 // indirect
 	github.com/felixge/httpsnoop v1.0.4 // indirect
 	github.com/go-logr/logr v1.4.2 // indirect
 	github.com/go-logr/stdr v1.2.2 // indirect
+	github.com/go-ole/go-ole v1.2.6 // indirect
+	github.com/gogo/protobuf v1.3.2 // indirect
 	github.com/golang-jwt/jwt/v5 v5.2.1 // indirect
 	github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
 	github.com/golang/protobuf v1.5.4 // indirect
@@ -56,28 +72,47 @@ require (
 	github.com/hashicorp/terraform-registry-address v0.2.3 // indirect
 	github.com/hashicorp/terraform-svchost v0.1.1 // indirect
 	github.com/hashicorp/yamux v0.1.1 // indirect
+	github.com/klauspost/compress v1.16.0 // indirect
 	github.com/kylelemons/godebug v1.1.0 // indirect
+	github.com/lufia/plan9stats v0.0.0-20211012122336-39d0f177ccd0 // indirect
+	github.com/magiconair/properties v1.8.7 // indirect
 	github.com/mattn/go-colorable v0.1.13 // indirect
 	github.com/mattn/go-isatty v0.0.20 // indirect
 	github.com/mitchellh/copystructure v1.2.0 // indirect
 	github.com/mitchellh/go-testing-interface v1.14.1 // indirect
 	github.com/mitchellh/go-wordwrap v1.0.1 // indirect
 	github.com/mitchellh/mapstructure v1.5.0 // indirect
 	github.com/mitchellh/reflectwalk v1.0.2 // indirect
+	github.com/moby/patternmatcher v0.6.0 // indirect
+	github.com/moby/sys/sequential v0.5.0 // indirect
+	github.com/moby/sys/user v0.1.0 // indirect
+	github.com/moby/term v0.5.0 // indirect
+	github.com/morikuni/aec v1.0.0 // indirect
 	github.com/oklog/run v1.1.0 // indirect
+	github.com/opencontainers/go-digest v1.0.0 // indirect
+	github.com/opencontainers/image-spec v1.1.0 // indirect
 	github.com/pkg/browser v0.0.0-20240102092130-5ac0b6a4141c // indirect
+	github.com/pkg/errors v0.9.1 // indirect
+	github.com/power-devops/perfstat v0.0.0-20210106213030-5aafc221ea8c // indirect
+	github.com/shirou/gopsutil/v3 v3.23.12 // indirect
+	github.com/shoenig/go-m1cpu v0.1.6 // indirect
+	github.com/sirupsen/logrus v1.9.3 // indirect
 	github.com/tidwall/match v1.1.1 // indirect
 	github.com/tidwall/pretty v1.2.1 // indirect
+	github.com/tklauser/go-sysconf v0.3.12 // indirect
+	github.com/tklauser/numcpus v0.6.1 // indirect
 	github.com/vmihailenco/msgpack v4.0.4+incompatible // indirect
 	github.com/vmihailenco/msgpack/v5 v5.4.1 // indirect
 	github.com/vmihailenco/tagparser/v2 v2.0.0 // indirect
+	github.com/yusufpapurcu/wmi v1.2.3 // indirect
 	github.com/zclconf/go-cty v1.14.4 // indirect
 	go.opencensus.io v0.24.0 // indirect
 	go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.52.0 // indirect
 	go.opentelemetry.io/otel v1.27.0 // indirect
 	go.opentelemetry.io/otel/metric v1.27.0 // indirect
 	go.opentelemetry.io/otel/trace v1.27.0 // indirect
 	golang.org/x/crypto v0.24.0 // indirect
+	golang.org/x/exp v0.0.0-20230510235704-dd950f8aeaea // indirect
 	golang.org/x/mod v0.18.0 // indirect
 	golang.org/x/sync v0.7.0 // indirect
 	golang.org/x/sys v0.21.0 // indirect