diff --git a/presto-docs/src/main/sphinx/release.rst b/presto-docs/src/main/sphinx/release.rst index d6ee388bb32f7..7d4aa77f92e0b 100644 --- a/presto-docs/src/main/sphinx/release.rst +++ b/presto-docs/src/main/sphinx/release.rst @@ -5,6 +5,7 @@ Release Notes .. toctree:: :maxdepth: 1 + Release-0.293 [2025-05-29] Release-0.292 [2025-03-28] Release-0.291 [2025-01-27] Release-0.290 [2024-11-01] diff --git a/presto-docs/src/main/sphinx/release/release-0.293.rst b/presto-docs/src/main/sphinx/release/release-0.293.rst new file mode 100644 index 0000000000000..7ad38cc0b90e2 --- /dev/null +++ b/presto-docs/src/main/sphinx/release/release-0.293.rst @@ -0,0 +1,143 @@ +============= +Release 0.293 +============= + +**Highlights** +============== + +* Fix ROLLBACK statement to ensure it successfully aborts non-auto commit transactions corrupted by failed statements. `#23247 `_ +* Improve coordinator performance by introducing Thrift serialization. `#25079 `_ and `#25020 `_ +* Improve performance of ``ORDER BY`` queries on single node execution. `#25022 `_ +* Add authentication capabilities to Presto router. `#24407 `_ +* Add coordinator health checks to Presto router. `#24449 `_ +* Add support for custom scheduler plugin in the Presto Router. `#24439 `_ +* Add DDL SQL support for ``SHOW CREATE SCHEMA``. `#24356 `_ +* Add :func:`longest_common_prefix(string1, string2) -> varchar()` string function. `#24891 `_ +* Add support for row filtering and column masking in access control. `#24277 `_ +* Add security-related headers to the static resources served from the Presto Router UI, including: ``Content-Security-Policy``, ``X-Content-Type-Options``. See reference docs `Content-Security-Policy `_ and `X-Content-Type-Options `_. `#25165 `_ +* Add support for SSL/TLS encryption for HMS. `#24745 `_ +* Add support for the procedure ``.system.invalidate_manifest_file_cache()`` for ManifestFile cache invalidation in Iceberg. `#24831 `_ +* Add support for `JSON `_ type in MongoDB. `#25089 `_ +* Add support for `GEOMETRY `_ type in the MySQL connector. `#24996 `_ +* Add a display for number of queued and running queries for each Resource Group subgroup in the UI. `#24830 `_ +* Add `runtime metrics collection for S3 Filesystem `_. `#24554 `_ + +**Details** +=========== + +General Changes +_______________ +* Fix ROLLBACK statement to ensure it successfully aborts non-auto commit transactions corrupted by failed statements. `#23247 `_ +* Fix a bug in left join to semi join optimizer which leads to filter source variable not found error. `#25111 `_ +* Fix a bug where a mirrored :func:`arrays_overlap(x, y) -> boolean` function does not return the correct value. `#23845 `_ +* Fix returning incorrect results from the :func:`second(x) -> bigint()` UDF when a timestamp is in a time zone with an offset that is at the granularity of seconds. `#25090 `_ +* Fix issue with loading Redis HBO provider. `#24835 `_ +* Improve memory usage of readers of complex type columns. `#24912 `_ +* Improve the efficacy of ACL checks by delaying them until after SQL view processing. `#24955 `_ and `#24927 `_ +* Improve coordinator performance by introducing Thrift serialization. `#25079 `_ and `#25020 `_ +* Improve performance of operator stats reporting. `#24921 `_ +* Improve performance of ``ORDER BY`` queries on single node execution. `#25022 `_ +* Improve query plans by converting table scans without data to empty values nodes. `#25155 `_ +* Improve performance of ``LOJ + IS NULL`` queries by adding distinct on right side of semi-join for it. `#24884 `_ +* Add DDL SQL support for ``SHOW CREATE SCHEMA``. `#24356 `_ +* Add configuration property ``hive.metastore.catalog.name`` to pass catalog names to the metastore, enabling catalog-based schema management and filtering. `#24235 `_ +* Add :func:`cosine_similarity(x, y) -> double()` for array arguments. `#25056 `_ +* Add type rewrite support for native execution. This feature can be enabled by ``native-execution-type-rewrite-enabled`` configuration property and ``native_execution_type_rewrite_enabled`` session property. `#24916 `_ +* Add session property :ref:`admin/properties-session:\`\`query_client_timeout\`\`` to configure how long a query can run without contact from the client application, such as the CLI, before it is abandoned. `#25210 `_ +* Add :func:`longest_common_prefix(string1, string2) -> varchar()` string function. `#24891 `_ +* Replace ``exchange.compression-enabled``, ``fragment-result-cache.block-encoding-compression-enabled``, ``experimental.spill-compression-enabled`` with ``exchange.compression-codec``, ``fragment-result-cache.block-encoding-compression-codec`` to enable compression codec configurations. Supported codecs include GZIP, LZ4, LZO, SNAPPY, ZLIB and ZSTD. `#24670 `_ +* Replace dependency from PostgreSQL to redshift-jdbc42 to address `CVE-2024-1597 `_, `CVE-2022-31197 `_, and `CVE-2020-13692 `_. `#25106 `_ +* Upgrade netty version to 4.1.119.Final. `#24971 `_ + +Prestissimo (Native Execution) Changes +______________________________________ +* Improve batch shuffle performance by doing sorted serialization. `#24953 `_ +* Improve batch shuffle sorted serialization by using appropriate sorting key values for each buffer. `#25015 `_ +* Add type rewrite support for native execution. This feature can be enabled by ``native-execution-type-rewrite-enabled`` configuration property and ``native_execution_type_rewrite_enabled`` session property. `#24916 `_ +* Add `runtime metrics collection for S3 Filesystem `_. `#24554 `_ +* Add session property ``native_request_data_sizes_max_wait_sec`` for the maximum wait time for exchange long poll requests in seconds. `#24918 `_ +* Add session property ``native_streaming_aggregation_eager_flush`` to control if streaming aggregation should flush its output rows as quickly as it can. `#24947 `_ +* Add session property ``native_debug_memory_pool_name_regex`` to trace allocations of memory pools matching the regex. `#24833 `_ +* Replace using native functions with Java functions for creating failure functions when native execution is enabled. `#24792 `_ +* Remove worker configuration property ``register-test-functions``. `#24853 `_ + + +Router Changes +______________ + +* Add support for custom scheduler plugin in the Presto Router. `#24439 `_ +* Fix Round Round robin scheduler candidate cluster index, by adding group specific index. `#24580 `_ +* Add authentication capabilities to Presto router. `#24407 `_ +* Add coordinator health checks to Presto router. `#24449 `_ +* Add counter JMX metrics to Presto router. `#24449 `_ + +Security Changes +________________ +* Fix the issue of sensitive data such as passwords and access keys being exposed in logs by redacting sensitive field values. `#24886 `_ +* Add security-related headers to the static resources served from the Presto Router UI, including: ``Content-Security-Policy``, ``X-Content-Type-Options``. See reference docs `Content-Security-Policy `_ and `X-Content-Type-Options `_. `#25165 `_ +* Add support for access control row filters and column masks on views. `#25052 `_ +* Add support for row filtering and column masking in access control. `#24277 `_ +* Upgrade commons-beanutils to version 1.9.4 in response to `CVE-2014-0114 `_. `#24665 `_ +* Upgrade plexus-utils to version 3.6.0 in response to `CVE-2017-1000487 `_. `#24665 `_ +* Upgrade zookeeper to 3.9.3 to fix security vulnerability in presto-accumulo, presto-delta, presto-hive, presto-kafka, and presto-hudi in response to `CVE-2023-44981 `_. `#24403 `_ +* Upgrade MySQL to 9.2.0 to fix `CVE-2023-22102 `_. `#24754 `_ +* Upgrade kotlin-stdlib-jdk8 to 1.9.25. `#24971 `_ +* Upgrade snappy-java version at 1.1.10.4 across the codebase to address `CVE-2023-43642 `_. `#25106 `_ +* Upgrade commons-compress version to 1.26.2 across the codebase to address `CVE-2021-35517 `_, `CVE-2021-35516 `_, `CVE-2021-36090 `_, `CVE-2021-35515 `_, and `CVE-2024-25710 `_. `#25106 `_ + +Web UI Changes +______________ + +* Add a display for number of queued and running queries for each Resource Group subgroup in the UI. `#24830 `_ + +Delta Lake Connector Changes +____________________________ +* Fix a bug where after an incremental update with null values is made, reads start timing out. `#24920 `_ + +Elasticsearch Connector Changes +_______________________________ +* Upgrade elasticsearch to 7.17.27 in response to `CVE-2024-43709 `_. `#23894 `_ + +Hive Connector Changes +______________________ +* Add support for Web Identity authentication in S3 security mapping with the ``hive.s3.webidentity.enabled`` property. `#24645 `_ +* Add support for SSL/TLS encryption for HMS with configuration properties ``hive.metastore.thrift.client.tls.enabled``, ``hive.metastore.thrift.client.tls.keystore-path``, ``hive.metastore.thrift.client.tls.keystore-password``, and ``hive.metastore.thrift.client.tls.truststore-password``. `#24745 `_ +* Replace listObjects with listObjectsV2 in PrestoS3FileSystem listPrefix. `#24794 `_ + + +Iceberg Connector Changes +_________________________ +* Fix to pass full session to avoid ``Unknown connector`` errors using the Nessie catalog. `#24803 `_ +* Add support for the procedure ``.system.invalidate_manifest_file_cache()`` for ManifestFile cache invalidation in Iceberg. `#24831 `_ +* Add support for the procedure ``.system.invalidate_statistics_file_cache()`` for StatisticsFile cache invalidation in Iceberg. `#24831 `_ +* Add support for bucket transform for columns of type ``TimeType`` in Iceberg table. `#24829 `_ +* Replace RowDelta with AppendFiles for insert-only statements such as INSERT and CTAS. `#24989 `_ + +JDBC Connector Changes +______________________ +* Add ``list-schemas-ignored-schemas`` configuration property for JDBC connectors. `#24994 `_ + +Kafka Connector Changes +_______________________ +* Add support for optional Apache Kafka SASL. `#24798 `_ + +MongoDB Connector Changes +_________________________ +* Add support for `JSON `_ type in MongoDB. `#25089 `_ + +MySQL Connector Changes +_______________________ +* Add support for `GEOMETRY `_ type in the MySQL connector. `#24996 `_ + +SQL Server Connector Changes +____________________________ +* Upgrade SQL Server driver to version 12.8.1 to support NTLM authentication. See :ref:`connector/sqlserver:authentication`. This is a breaking change for existing connections, as the driver sets the encrypt property to ``true`` by default. To connect to a non-SSL SQL Server instance, you must set ``encrypt=false`` in your connection configuration to avoid connectivity issues. `#24686 `_ + +Documentation Changes +_____________________ +* Document :doc:`../presto_cpp/sidecar` and native sidecar plugin. `#24883 `_ + +**Credits** +=========== + +Akinori Musha, Amit Dutta, Anant Aneja, Andrew Xie, Andrii Rosa, Anurag Dwivedi, Arjun Gupta, Bryan Cutler, Chen Yang, Christian Zentgraf, Deepak Majeti, Deepak Mehra, Denodo Research Labs, Elbin Pallimalil, Emily (Xuetong) Sun, Ethan Zhang, Facebook Community Bot, Feilong Liu, Gary Helmling, Haritha Koloth, Hazmi, HeidiHan0000, Heng Xiao, Jacob Khaliqi, James Petty, Jay Narale, Jim Simon, Jimmy Lu, Joe Abraham, Ke Wang, Ke Wang, Kevin Tang, Kevin Wilfong, Krishna Pai, Li Zhou, Linsong Wang, Mariam Almesfer, Miguel Blanco Godón, Najib Adan, Natasha Sehgal, Nidhin Varghese, Nikhil Collooru, Nivin C S, Pradeep Vaka, Pramod Satya, Prashant Golash, Pratik Joseph Dabre, Rebecca Schlussel, Reetika Agrawal, Samuel Majoros, Sayari Mukherjee, Serge Druzkin, Sergey Pershin, Shahim Sharafudeen, Shang Ma, Shelton Cai, Shijin, Steve Burnett, Tim Meehan, Xiao Du, Xiaoxuan Meng, Xin Zhang, Yihong Wang, Ying, Yuanda (Yenda) Li, Zac Blanco, Zac Wen, aditi-pandit, auden-woolfson, ebonnal, jp-sivaprasad, lukmanulhakkeem, mecit-san, mima0000, mohsaka, namya28, tanjialiang, vhsu14, wangd, wraymo