Dataflow Templates 2025-09-09-00_RC00

fix: update MongoDB container image tag in integration test setup (#2…

Dataflow Templates 2025-09-02-00_RC00

What's Changed

Improvements

• feat(import): add early index create threshold parameter by @liferoad in #2686
• [Yaml]: add dependency requirements etc by @derrickaw in #2694
• Bump org.twdata.maven:mojo-executor from 2.4.0 to 2.4.1 by @dependabot[bot] in #2700
• Bump org.codehaus.mojo:extra-enforcer-rules from 1.8.0 to 1.10.0 by @dependabot[bot] in #2699
• fix readme outputs for python and yaml modules by @derrickaw in #2704

Bug fixes

• fix(mongodb): handle special floating point values in Gson serialization by @liferoad in #2707

Full Changelog: 2025-08-26-00_RC00...2025-09-02-00_RC00

Dataflow Templates 2025-08-26-00_RC00

What's Changed

Improvements

• Bump com.google.apis:google-api-services-datastream from v1-rev20230902-2.0.0 to v1-rev20250722-2.0.0 by @dependabot[bot] in #2611
• build: update astra-io dependency to 4.18.1 by @liferoad in #2654
• build: add org.json dependency with secure version by @liferoad in #2661
• fix: enforce non-vulnerable version of okio to address by @liferoad in #2663
• fix: remove vendored Guava dependency to fix CVE-2023-2976 by @liferoad in #2669
• feat: enforce cypher 5 for generated queries by @nord-erik in #2620

Bug fixes

• Update FormatDatastreamRecordToJson.java by @dhercher in #2665
• Update kafka to bq README etc by @derrickaw in #2668
• revise metadata link and update docs by @derrickaw in #2662

New Contributors

• @nord-erik made their first contribution in #2620

Full Changelog: 2025-08-19-00_RC00...2025-08-26-00_RC00

Dataflow Templates 2025-08-19-00_RC00

What's Changed

Improvements

• Integration tests - Postgres to Postgres for Datastream to SQL Template by @rahulkumar0630 in #2617
• Upgrade Templates to Beam 2.67.0 by @Amar3tto in #2644
• Schema Map Support for Tables by @rahulkumar0630 in #2629

Full Changelog: 2025-08-12-00_RC00...2025-08-19-00_RC00

Dataflow Templates 2025-08-12-00_RC00

What's Changed

Improvements

• Replace session file usage with ISchemaMapper and add string overrides support by @Deep1998 in #2561
• Bump parquet-avro version to 1.15.2 by @jrmccluskey in #2606

Full Changelog: 2025-08-05-00_RC01...2025-08-12-00_RC00

Dataflow Templates 2025-08-05-00_RC01

What's Changed

Improvements

• Updates AvroConverters schema documentation by @chamikaramj in #2616
• Adding support for Enum, Hstore, and Ltree by @rahulkumar0630 in #2588

New Contributors

• @chamikaramj made their first contribution in #2616
• @rahulkumar0630 made their first contribution in #2588

Full Changelog: 2025-07-29-00_RC00...2025-08-05-00_RC01

Dataflow Templates 2025-07-29-00_RC00

What's Changed

Improvements

• Support order by Un-deleted data by @dhercher in #2587
• added managed IO templates by @liferoad in #2504
• BigQuery to Bigtable handle empty rows by @jhambleton in #2598

Bug fixes

• Update FormatDatastreamRecordToJson.java by @dhercher in #2580
• Supporting integer for boolean in CSV import by @VardhanThigle in #2599

New Contributors

• @DeeperMind made their first contribution in #2134

Full Changelog: 2025-07-22-00_RC00...2025-07-29-00_RC00

Dataflow Templates 2025-07-22-00_RC00

What's Changed

Improvements

• Reduce IT Times In Kafka Templates by @fozzie15 in #2565
• fix: read neo4j driver version from maven by @Emrehzl94 in #2562
• Bump com.google.cloud:google-cloud-dlp from 2.1.0 to 3.72.0 by @dependabot[bot] in #2566
• Fix negative value modulo bug by @dhercher in #2567
• Update FormatDatastreamJsonToJson.java by @dhercher in #2569
• Bq to Bt support for sparse data format and user defined cell timestamps by @jhambleton in #2568
• Refactor template to avoid using session file for type info by @Deep1998 in #2529
• [Spanner-to-sourcedb] Not reading generate columns from Spanner during reverse replication by @darshan-sj in #2571
• added loginTimeout for the datasource connection by @liferoad in #2551

Full Changelog: 2025-07-15-00_RC00...2025-07-22-00_RC00

Dataflow Templates 2025-07-15-00_RC00

What's Changed

Improvements

• fix parent project in BigQueryToParquet by @stankiewicz in #2530
• Add source ddl classes by @Deep1998 in #2525

Bug fixes

• Remove additional job params and vpc settings from bulk ITs by @Deep1998 in #2537
• docs: Updates incorrect default value by @shuesc1 in #2531
• Reverse Replication:: All Datatypes PK IT for delete pKey changes by @VardhanThigle in #2536
• Refactor reverse ITs to avoid using global job params by @Deep1998 in #2563

New Contributors

• @shuesc1 made their first contribution in #2531

Full Changelog: 2025-07-08-00_RC00...2025-07-15-00_RC00

Dataflow Templates 2025-07-08-00_RC00

What's Changed

Improvements

• Add change stream timeout parameter to BigtableChangeStreamsToPubSub template by @jonnylaw in #2500
• [SpannerToSourceDB] Update Lookback time for Deletes from 1 second to 1 microsecond by @darshan-sj in #2505
• Bump com.google.cloud.bigtable:bigtable-hbase-beam from 2.11.0 to 2.15.2 by @dependabot in #2509

Bug fixes

• [Fix]: Normalize Years and Months while constructing ISO8601 Duration String by @sagarwaal in #2484
• Construct correct Reverse replication delete DML when there pkey change between source and spanner. by @VardhanThigle in #2506

New Contributors

• @jonnylaw made their first contribution in #2500

Full Changelog: 2025-07-02-00_RC00...2025-07-08-00_RC00