From 68888d8dc656dc3d6d3e3da23665f8386ab05100 Mon Sep 17 00:00:00 2001 From: Colebow Date: Fri, 7 Jun 2024 12:30:57 -0700 Subject: [PATCH 1/2] Add Trino 450 release notes --- docs/src/main/sphinx/connector/pinot.md | 1 + docs/src/main/sphinx/release.md | 1 + docs/src/main/sphinx/release/release-450.md | 128 ++++++++++++++++++++ 3 files changed, 130 insertions(+) create mode 100644 docs/src/main/sphinx/release/release-450.md diff --git a/docs/src/main/sphinx/connector/pinot.md b/docs/src/main/sphinx/connector/pinot.md index cc6a5a27274e..7c11b331c164 100644 --- a/docs/src/main/sphinx/connector/pinot.md +++ b/docs/src/main/sphinx/connector/pinot.md @@ -109,6 +109,7 @@ WHERE bar = 3 AND baz IN ('ONE', 'TWO', 'THREE') LIMIT 25000; ``` +(pinot-dynamic-tables)= ## Dynamic tables To leverage Pinot's fast aggregation, a Pinot query written in PQL can be used as the table name. diff --git a/docs/src/main/sphinx/release.md b/docs/src/main/sphinx/release.md index 047e49bc93ee..6b8b8084ebc2 100644 --- a/docs/src/main/sphinx/release.md +++ b/docs/src/main/sphinx/release.md @@ -6,6 +6,7 @@ ```{toctree} :maxdepth: 1 +release/release-450 release/release-449 release/release-448 release/release-447 diff --git a/docs/src/main/sphinx/release/release-450.md b/docs/src/main/sphinx/release/release-450.md new file mode 100644 index 000000000000..f2191c7f7e1f --- /dev/null +++ b/docs/src/main/sphinx/release/release-450.md @@ -0,0 +1,128 @@ +# Release 450 (19 Jun 2024) + +## General + +* Add support for specifying an Azure blob endpoint for accessing spooling in + fault-tolerant execution with the `exchange.azure.endpoint` configuration + property. ({issue}`22218`) +* Expose driver execution statistics via JMX. ({issue}`22427`) +* Improve performance of the {func}`first_value` and {func}`last_value` + functions. ({issue}`22092`) +* Improve performance for large clusters under heavy workloads. ({issue}`22039`) +* Improve performance of queries with simple predicates. This optimization can + be disabled using the `experimental.columnar-filter-evaluation.enabled` + configuration property or the `columnar_filter_evaluation_enabled` session + property. ({issue}`21375`) +* {{breaking}} Improve performance of aggregations containing a `DISTINCT` + clause, and replace the `optimizer.mark-distinct-strategy` and + `optimizer.optimize-mixed-distinct-aggregations` configuration properties with + the new `optimizer.distinct-aggregations-strategy` property. ({issue}`21907`) +* Improve performance of reading JSON files. ({issue}`22348`) +* Improve performance for the {func}`date_trunc`, {func}`date_add`, and + {func}`date_diff` functions. ({issue}`22192`) +* Fix failure when loading the [](/admin/event-listeners-openlineage). ({issue}`22228`) +* Fix potential incorrect results when metadata or table data in certain + connectors is updated or deleted. ({issue}`22285`) + +## Security + +* Add support for using web identity exclusively for authentication when running + on Amazon EKS with the legacy S3 file system enabled. This can be configured + via the `trino.s3.use-web-identity-token-credentials-provider` property. ({issue}`22162`) +* Add support for exclusively using web identity for authentication when using + Amazon EKS with + [IAM roles](https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html) + by setting the + `s3.use-web-identity-token-credentials-provider` configuration property. ({issue}`22163`) + +## JDBC driver + +* Add support for the `assumeNullCatalogMeansCurrent` connection property. When + enabled, a `null` value for the `catalog` parameter in `DatabaseMetaData` + methods is assumed to mean the current catalog. If no current catalog is + set, the behaviour is unmodified. ({issue}`20866`) + +## BigQuery connector + +* Add support for metadata caching when the + `bigquery.case-insensitive-name-matching` configuration property is enabled. ({issue}`10740`) +* {{breaking}} Automatically configure BigQuery scan parallelism, and remove the + `bigquery.parallelism` configuration property. ({issue}`22279`) + +## Cassandra connector + +* Fix incorrect results when specifying a value for the + `cassandra.partition-size-for-batch-select` configuration property. ({issue}`21940`) + +## ClickHouse connector + +* Improve performance of `ORDER BY ... LIMIT` on non-textual types by pushing + execution down to the underlying database. ({issue}`22174`) + +## Delta Lake connector + +* Add support for concurrent `UPDATE`, `MERGE`, and `DELETE` queries. ({issue}`21727`) +* Add support for using table statistics with `TIMESTAMP` types. ({issue}`21878`) +* Add support for reading tables with + [type widening](https://docs.delta.io/latest/delta-type-widening.html). ({issue}`21756`) +* Set the default value for the `s3.max-connections` configuration property + to 500. ({issue}`22209`) +* Fix failure when reading a `TIMESTAMP` value after the year 9999. ({issue}`22184`) +* Fix failure when reading tables with the unsupported `variant` type. ({issue}`22310`) + +## Hive connector + +* Add support for `integer` to `varchar` and `decimal` to `varchar` type + coercion in unpartitioned tables. ({issue}`22246`, {issue}`22293`) +* Add support for `double` to `varchar` type coercion in unpartitioned tables + using Parquet files. ({issue}`22277`) +* Add support for `float` to `varchar` type coercion. ({issue}`22291`) +* Set the default value for the `s3.max-connections` configuration property + to 500. ({issue}`22209`) + +## Hudi connector + +* Set the default value for the `s3.max-connections` configuration property + to 500. ({issue}`22209`) + +## Iceberg connector + +* Add support for reading + [UniForm](https://docs.delta.io/latest/delta-uniform.html) tables. ({issue}`22106`) +* Add support for the `TRUNCATE` statement. ({issue}`22340`) +* {{breaking}} Add support for V2 of the Nessie REST API. Previous behavior can + be restored by setting the `iceberg.nessie-catalog.client-api-version` + configuration property to `V1`. ({issue}`22215`) +* Improve performance when reading by populating `split_offsets` in file + metadata. ({issue}`9018`) +* Set the default value for the `s3.max-connections` configuration property + to 500. ({issue}`22209`) +* Fix failure when reading Parquet files that don't have `field-id` on + structured types. ({issue}`22347`) + +## MariaDB connector + +* Add support for [fault-tolerant execution](/admin/fault-tolerant-execution). ({issue}`22328`) +* Improve performance of listing table columns. ({issue}`22241`) + +## Memory connector + +* Add support for the `TRUNCATE` statement. ({issue}`22337`) + +## MySQL connector + +* Improve performance of listing table columns. ({issue}`22241`) + +## Pinot connector + +* Add support for the + [`enableNullHandling` query option](https://docs.pinot.apache.org/developers/advanced/null-value-support#advanced-null-handling-support). ({issue}`22214`) +* Fix failure when using [dynamic tables](pinot-dynamic-tables). ({issue}`22301`) + +## Redshift connector + +* Improve performance of listing table columns. ({issue}`22241`) + +## SingleStore connector + +* Improve performance of listing table columns. ({issue}`22241`) From d3e525e41b8c690a54a6a22baa429e50bbfd0a5a Mon Sep 17 00:00:00 2001 From: Colebow Date: Wed, 19 Jun 2024 18:19:59 -0700 Subject: [PATCH 2/2] Document S3 max connections default change --- docs/src/main/sphinx/object-storage/file-system-s3.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/src/main/sphinx/object-storage/file-system-s3.md b/docs/src/main/sphinx/object-storage/file-system-s3.md index 3e42b69ac41e..78445958808e 100644 --- a/docs/src/main/sphinx/object-storage/file-system-s3.md +++ b/docs/src/main/sphinx/object-storage/file-system-s3.md @@ -50,7 +50,7 @@ support: - Switch to activate billing transfer cost to the requester. Defaults to `false`. * - `s3.max-connections` - - Maximum number of connections to S3. + - Maximum number of connections to S3. Defaults to `500`. * - `s3.connection-ttl` - Maximum time [duration](prop-type-duration) allowed to reuse connections in the connection pool before being replaced.