Add release notes for 0.292

[prestodb-ci]

Missing Release Notes

Amit Dutta

• [native] Advance velox. #24708 [native] Advance velox. (Merged by: Amit Dutta)
• [native] Advance velox, fix build and unit test. #24470 [native] Advance velox, fix build and unit test. (Merged by: Amit Dutta)

Arjun Gupta

• Dynamically compute node memory based on configured spark executor memory #24714 Dynamically compute node memory based on configured spark executor memory (Merged by: Arjun Gupta)

Bryan Cutler

• [native] Add Apache Arrow Flight Connector #24504 [native] Add Apache Arrow Flight Connector (Merged by: Bryan Cutler)

Deepak Majeti

• [native] Default task.max-drivers-per-task to hardware concurrency #24642 [native] Default task.max-drivers-per-task to hardware concurrency (Merged by: Deepak Majeti)

Eric Liu

• Improve boostrap log to expose the wrong classLoader #24533 Improve boostrap log to expose the wrong classLoader (Merged by: Rebecca Schlussel)

Gary Helmling

• Add ConnectorMetadata.commitPageSinkAsync hook for ConnectorDeleteTableHandle #24783 Add ConnectorMetadata.commitPageSinkAsync hook for ConnectorDeleteTableHandle (Merged by: Gary Helmling)
• Add ConnectorDeleteTableHandle to ConnectorProtocol #24721 Add ConnectorDeleteTableHandle to ConnectorProtocol (Merged by: Gary Helmling)

HeidiHan0000

• Add requestDataSizesMaxWaitSec to Prestissimo system configs #24774 Add requestDataSizesMaxWaitSec to Prestissimo system configs (Merged by: HeidiHan0000)
• Add spill related configs to system configs #24726 Add spill related configs to system configs (Merged by: HeidiHan0000)

Jialiang Tan

• Add new memory arbitration failure error code name #24773 Add new memory arbitration failure error code name (Merged by: Amit Dutta)

Joe Giardino

• [native] Fix includes #24625 [native] Fix includes (Merged by: Swapnil)

Mariam Almesfer

• Security Fix: Okio CVE-2023-3635 + OkHttp Jar Update #23796 Security Fix: Okio CVE-2023-3635 + OkHttp Jar Update (Merged by: Timothy Meehan)

Matt Karrmann

• Include Table Metadata in Operator Logs #24590 Include Table Metadata in Operator Logs (Merged by: Nikhil Collooru)

Minhan Cao

• [docs] Add documentation for cache configuration properties #24623 [docs] Add documentation for cache configuration properties (Merged by: Steve Burnett)
• [native] Add LinuxMemoryChecker check/warning to ensure system-mem-limit-gb is reasonably set #24149 [native] Add LinuxMemoryChecker check/warning to ensure system-mem-limit-gb is reasonably set (Merged by: Christian Zentgraf)
• [docs] Add documentation to note "-gb" Prestissimo Configs are using GiB units and not gB units #24607 [docs] Add documentation to note "-gb" Prestissimo Configs are using GiB units and not gB units (Merged by: Steve Burnett)

Nidhin Varghese

• Add support for multiple query event listeners #24456 Add support for multiple query event listeners (Merged by: Aditi Pandit)

Pradeep Vaka

• [native]: Add operator override for xxhash64, combine_hash internal functions #24503 [native]: Add operator override for xxhash64, combine_hash internal functions (Merged by: Aditi Pandit)

Pratik Joseph Dabre

• Add a native function namespace manager #23358 Add a native function namespace manager (Merged by: Pratik Joseph Dabre)

Richard Barnes

• [native] Remove unused private from github/presto-trunk/presto-native-execution/presto_cpp/main/http/filters/InternalAuthenticationFilter.h +1 #24734 [native] Remove unused private from github/presto-trunk/presto-native-execution/presto_cpp/main/http/filters/InternalAuthenticationFilter.h +1 (Merged by: Amit Dutta)

Shahim Sharafudeen

• Upgrade vulnerable version of reload4j and aws-java-sdk dependencies #24606 Upgrade vulnerable version of reload4j and aws-java-sdk dependencies (Merged by: Ying)
• Upgrade json-smart version to 2.5.2 in response to CVE-2024-57699 #24631 Upgrade json-smart version to 2.5.2 in response to CVE-2024-57699 (Merged by: Ying)

Shakyan Kushwaha

• [native] Allow options for wget and tar commands during setup #24455 [native] Allow options for wget and tar commands during setup (Merged by: Christian Zentgraf)

Shang Ma

• Put event loop behind a toggle #24668 Put event loop behind a toggle (Merged by: Shang Ma)
• Optimize how we merge multiple operatorStats #24414 Optimize how we merge multiple operatorStats (Merged by: Andrii Rosa)

Xiao Du

• fix Update json_extract to Produce Canonicalized Output #24614 fix Update json_extract to Produce Canonicalized Output (Merged by: XiaoDu)

namya28

• Upgrade accumulo to 1.10.1 to fix CVE-2020-17533 #24438 Upgrade accumulo to 1.10.1 to fix CVE-2020-17533 (Merged by: Timothy Meehan)
• Upgrading hive-dwrf version to 0.8.7 which involved upgrading snappy version to 0.5 to fix CVE-2024-36124 #24461 Upgrading hive-dwrf version to 0.8.7 which involved upgrading snappy version to 0.5 to fix CVE-2024-36124 (Merged by: Timothy Meehan)

wypb

• [native] Add support for ORC reader #23037 [native] Add support for ORC reader (Merged by: Aditi Pandit)

Extracted Release Notes

• Add Support for Iceberg table sort orders #21977 (Author: Nidhin Varghese): Add Support for Iceberg table sort orders
  • Support for Iceberg table sort orders. Tables can be created to add a list of sorted_by columns which will be used to order files written to the table.
• Fix timestamp with timezone mapping in iceberg type converter #23534 (Author: auden-woolfson): Fix timestamp with timezone mapping in iceberg type converter
  • Add logic to iceberg type converter for timestamp with timezone :pr:23534.
• [native] Add a config property for excluding invalid worker session properties #23968 (Author: Pratik Joseph Dabre): [native] Add a config property for excluding invalid worker session properties
  • Add configuration property exclude-invalid-worker-session-properties.
• Add Exchange before GroupId to improve Partial Aggregation #24047 (Author: Anant Aneja): Add Exchange before GroupId to improve Partial Aggregation
  • Added a new optimizer rule to add exchanges below a combination of partial aggregation+ GroupId . Enabled with the boolean session property enable_forced_exchange_below_group_id.
• Add SPI for delegating row expression optimizer #24144 (Author: Timothy Meehan): Add SPI for delegating row expression optimizer
  • Add CoordinatorPlugin#getExpressionOptimizerFactories to customize expression evaluation in the Presto coordinator. :pr:24144.
• presto-ui forwardfit #24167 (Author: Shahad): presto-ui forwardfit
  • Upgrade bootstrap to version 5.
  • Upgrade jQuery to version 3.7.1.
  • Replace depreciated dagre-d3 with dagre-d3-es in response to a high severity vulnerability WS-2022-0322.
• Add a native type manager #24179 (Author: Pratik Joseph Dabre): Add a native type manager
  • Add a native type manager.
• [native] Introduce module presto-native-tests #24234 (Author: Pramod Satya): [native] Introduce module presto-native-tests
  • Introduces module presto-native-tests to run end-to-end tests with Presto native workers.
• Add UPDATE support for Iceberg #24281 (Author: Zac Blanco): Add UPDATE support for Iceberg
  • Iceberg connector support for UPDATE SQL statements.
• [Iceberg]Support renaming table on hive file catalog #24312 (Author: wangd): [Iceberg]Support renaming table on hive file catalog
  • Add support of renaming table for Iceberg connector when configured with HIVE file catalog.
• [Presto-Main] Add long overflow checks for IntervalDayTime #24353 (Author: librian415): [Presto-Main] Add long overflow checks for IntervalDayTime
  • Improve error handling of INTERVAL DAY, INTERVAL HOUR, and INTERVAL SECOND operators when experiencing overflows. :pr:24353.
• [Iceberg]Support setting warehouse data directory for Hadoop catalog #24397 (Author: wangd): [Iceberg]Support setting warehouse data directory for Hadoop catalog
  • Add table properties write.data.path to specify independent data write paths for Iceberg tables.
  • Add connector configuration property iceberg.catalog.hadoop.warehouse.datadir for Hadoop catalog to specify root data write path for its new created tables.
• Add a config flag tpcds.use-varchar-type in Presto - Java TPC-DS Connector #24406 (Author: Pratik Joseph Dabre): Add a config flag tpcds.use-varchar-type in Presto - Java TPC-DS Connector
  • Add config property tpcds.use-varchar-type to allow toggling of char columns to varchar columns.
• Enhancements to the presto router ui #24411 (Author: auden-woolfson): Enhancements to the presto router ui
  • Enhance presto router UI.
• [Iceberg] Add table and session property for split size #24417 (Author: Zac Blanco): [Iceberg] Add table and session property for split size
  • Add target_split_size_bytes session property.
  • Add read.split.target-size table property.
• Arrow Flight Connector Template #24427 (Author: Bryan Cutler): Arrow Flight Connector Template
  • Add Arrow Flight connector :pr:24427.
  • Add documentation for the :doc:/connector/base-arrow-flight :pr:24427.
• Avoid batch reading of nested decimals as this reader is not implemented #24440 (Author: Denodo Research Labs): Avoid batch reading of nested decimals as this reader is not implemented
  • Fix Parquet read failing for nested Decimal types :pr:24440.
• Upgrade libthrift to 0.14.1 due CVE-2020-13949 #24462 (Author: Denodo Research Labs): Upgrade libthrift to 0.14.1 due CVE-2020-13949
  • Upgrade libthrift to 0.14.1 in response to CVE-2020-13949 <https://github.com/advisories/GHSA-g2fg-mr77-6vrm>_.
• Fix getting views for Hive metastore 2.3+  #24466 (Author: Sayari Mukherjee): Fix getting views for Hive metastore 2.3+
  • Fix getting views for Hive metastore 2.3+.
• Upgrade the jar org.apache.commons:commons-text:1.10.0 to 1.13.0 #24467 (Author: sumi): Upgrade the jar org.apache.commons:commons-text:1.10.0 to 1.13.0
  • Upgrade commons-text to 1.13.0 in response to CVE-2024-47554<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-47554>_.
• Security Fix: Okio CVE-2023-3635 + OkHttp Jar Update  #24473 (Author: Mariam Almesfer): Security Fix: Okio CVE-2023-3635 + OkHttp Jar Update
  • Upgrade okio to 3.6.0 in response to CVE-2023-3635 <https://github.com/advisories/GHSA-w33c-445m-f8w7>.
  • Upgrade okhttp to 4.12.0 in response to CVE-2023-3635 <https://github.com/advisories/GHSA-w33c-445m-f8w7>.
• Update security protocol to TLS #24474 (Author: Shahim Sharafudeen): Update security protocol to TLS
  • Improve cryptographic protocol in response to java:S4423 <https://sonarqube.ow2.org/coding_rules?open=java%3AS4423&rule_key=java%3AS4423>_.
• Upgrade io.grpc library to 1.70.0 #24475 (Author: Dilli-Babu-Godari): Upgrade io.grpc library to 1.70.0
  • Upgrade the io.grpc library from version 1.68.0 to 1.70.0 in response to CVE-2024-7254<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-7254>, CVE-2020-8908<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-8908>.
  • Upgrade the errrorprone dependency from version 2.28.0 to 2.36.0.
• [Iceberg] Fix bugs in Iceberg statistics caching #24480 (Author: Zac Blanco): [Iceberg] Fix bugs in Iceberg statistics caching
  • Fix bug with missing statistics when the statistics file cache has a partial miss.
• [Iceberg] Add manifest file caching for HMS-based deployments #24481 (Author: Zac Blanco): [Iceberg] Add manifest file caching for HMS-based deployments
  • Add manifest file caching for deployments which use the Hive metastore.
  • Enable manifest caching by default.
• Upgrade org.apache.ratis dependency to address CVE-2020-15250 #24496 (Author: sumi): Upgrade org.apache.ratis dependency to address CVE-2020-15250
  • Upgrade org.apache.ratis to 3.1.3 in response to CVE-2020-15250<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-15250>_.
• Upgrade org.apache.logging.log4j:log4j-core and log4j-api libraries #24507 (Author: Dilli-Babu-Godari): Upgrade org.apache.logging.log4j:log4j-core and log4j-api libraries
  • Upgraded org.apache.logging.log4j:log4j-core from 2.17.1 to 2.24.3 in response to CVE-2024-47554<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-47554>.
  • Upgraded org.apache.logging.log4j:log4j-api from 2.17.1 to 2.24.3 in response to CVE-2024-47554 <https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-47554>.
• Update begin delete #24528 (Author: Shelton Cai): Update begin delete
  • Fix OSS connectors affected by changes.
  • Add serialization for new types.
  • Add pagesink for DELETES to support future use.
  • Update beginDelete to return the new types, and finishDelete to accept the new types.
  • Add a separate ConnectorDeleteTableHandle interface for ConnectorMetadata.beginDelete and ConnectorMetadata.finishDelete, replacing the previous usage of ConnectorTableHandle.
  • Add DeleteTableHandle support these changes in Metadata.
  • Replaced return type of beginDelete.
  • Fix IcebergTableHandle implementation to work with new types used in begin/finishDelete.
  • Replaced return type of beginDelete.
• add mysql compatible function bit_length #24531 (Author: shenh062326): add mysql compatible function bit_length
  • Add a MySQL-compatible function bit_length that returns the count of bits for the given string.
• fixed hive view uuid type parsing #24538 (Author: ajay-kharat): fixed hive view uuid type parsing
  • Fix Hive UUID type parsing.
• Plan checker sessionPass ConnectorSession to PlanChecker #24557 (Author: Rebecca Schlussel): Plan checker sessionPass ConnectorSession to PlanChecker
  • Add ConnectorSession as an argument to PlanChecker.validate and PlanChecker.validateFragment.
• Make the number of task event loop configurable #24565 (Author: Shang Ma): Make the number of task event loop configurable
  • Make the number of task event loop configurable via a configuration file.
• [native] Enable node pool type specification when reporting to the coordinator from a C++ worker  #24569 (Author: jay.narale): [native] Enable node pool type specification when reporting to the coordinator from a C++ worker
  • Enable node pool type specification when reporting to the coordinator from a C++ worker.
• Subclass FileHiveMetastore for Iceberg connector #24573 (Author: wangd): Subclass FileHiveMetastore for Iceberg connector
  • Add a dedicated subclass of FileHiveMetastore for Iceberg connector to capture and isolate the differences in behavior.
• [Iceberg] deprecate old table property names #24581 (Author: Zac Blanco): [Iceberg] deprecate old table property names
  • Deprecate some table property names in favor of property names from the Iceberg library. See :doc:connector/iceberg.rst.
• Change from DataSize to long to remove unnecessary data creation #24582 (Author: Shang Ma): Change from DataSize to long to remove unnecessary data creation
  • Improve scheduling by using long instead of DataSize for critical path.
• [native] fix(iceberg): Date partition value parse issue #24583 (Author: Mahadevuni Naveen Kumar): [native] fix(iceberg): Date partition value parse issue
  • Fix Iceberg date column filtering.
• Upgrade netty version to 4.1.118.Final #24586 (Author: inf): Upgrade netty version to 4.1.118.Final
  • Upgrade netty dependencies to version 4.1.115.Final in response to CVE-2024-47535 <https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-47535>.
• [Iceberg] Enable affinity scheduling on file sections #24598 (Author: Zac Blanco): [Iceberg] Enable affinity scheduling on file sections
  • Add support for the hive.affinity-scheduling-file-section-size configuration property and affinity_scheduling_file_section_size session property.
• [docs] Add Troubleshooting topic to documentation #24601 (Author: Steve Burnett): [docs] Add Troubleshooting topic to documentation
  • Add :doc:../troubleshoot topic to the Presto documentation.
• Refactor log4j-core and log4j-api dependencies out of root POM #24605 (Author: Dilli-Babu-Godari): Refactor log4j-core and log4j-api dependencies out of root POM
  • Refactored org.apache.logging.log4j:log4j-core out of root POM.
  • Refactored org.apache.logging.log4j:log4j-api out if root POM.
• Add overflow detection to IntervalYearMonthOperators #24617 (Author: Pramod Satya): Add overflow detection to IntervalYearMonthOperators
  • Fix addition, subtraction, multiplication and division of INTERVAL YEAR MONTH values.
• [docs] Move file-based metastore doc to installation/deployment.rst #24620 (Author: Steve Burnett): [docs] Move file-based metastore doc to installation/deployment.rst
  • Add documentation for file-based Hive metastore to :doc:/installation/deployment.
• Add hive session property to disable stats based filter reordering #24630 (Author: Ke): Add hive session property to disable stats based filter reordering
  • Add session property hive.stats_based_filter_reorder_disabled for disabling reader stats based filter reordering.
• Add native prefix to hive session property #24637 (Author: Ke): Add native prefix to hive session property
  • Rename session property hive.stats_based_filter_reorder_disabled to hive.native_stats_based_filter_reorder_disabled.
• Utilized Columns fix for views #24638 (Author: Kevin Tang): Utilized Columns fix for views
  • Improve analysis of utilized columns in a query by exploring view definitions and checking the utilized columns of the underlying tables.
• Fix check_access_control_on_utilized_columns_only for CTE #24647 (Author: Rebecca Schlussel): Fix check_access_control_on_utilized_columns_only for CTE
  • Fix a security bug when check_access_control_for_utlized_columns is true for queries that uses a WITH clause. Previously we would sometime not check permissions for certain columns that were used in the query. Now we will always check permissions for all columns used in the query. There are some corner cases for CTEs with the same name where we may check more columns than are used or fall back to checking all columns referenced in the query.
• Support HDFS and S3 path as warehouse directory for Hive file catalog #24660 (Author: wangd): Support HDFS and S3 path as warehouse directory for Hive file catalog
  • Enable file-based hive metastore to use HDFS/S3 location as warehouse dir.
• Convert DateTime to long along the critical path within coordinator #24673 (Author: Shang Ma): Convert DateTime to long along the critical path within coordinator
  • Improve scheduling by using long instead of DateTime for critical path.
• Fix silent overflow in DateTimeEncoding.pack #24674 (Author: Kevin Wilfong): Fix silent overflow in DateTimeEncoding.pack
  • Fix silently returning incorrect results when trying to construct a TimestampWithTimeZone from a value that has a unix timestamp that is too large/small.
• Upgrade build to be compatible with JDK17 #24677 (Author: Anant Aneja): Upgrade build to be compatible with JDK17
  • Add support to build Presto with JDK 17.
• Move IndexSourceNode to the SPI #24678 (Author: Rebecca Schlussel): Move IndexSourceNode to the SPI
  • Move IndexSourceNode to the SPI.
• Upgrade org.apache.calcite dependency to address CVE-2023-2976 #24706 (Author: sumi): Upgrade org.apache.calcite dependency to address CVE-2023-2976
  • Upgrade org.apache.calcite to 1.38.0 in response to CVE-2023-2976<https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-2976>_.
• Add missing shared arbitrator configs #24720 (Author: Jialiang Tan): Add missing shared arbitrator configs
  • Add Presto native shared arbitrator configuration properties:.
  • shared-arbitrator.memory-pool-abort-capacity-limit.
  • shared-arbitrator.memory-pool-min-reclaim-bytes.
  • shared-arbitrator.memory-reclaim-threads-hw-multiplier.
  • shared-arbitrator.global-arbitration-memory-reclaim-pct.
  • shared-arbitrator.global-arbitration-abort-time-ratio.
  • shared-arbitrator.global-arbitration-without-spill.
• upgrade prismjs #24765 (Author: Shahad): upgrade prismjs
  • Upgrade prismJs to 1.30.0 in response to CVE-2024-53382 <https://github.com/advisories/GHSA-x7hr-w5r2-h6wg>_.
• Utilized column analyzer unnest fix map case #24789 (Author: Kevin Tang): Utilized column analyzer unnest fix map case
  • Fix index error when a map column is passed into an unnest function by using the column analyzer to correctly map key and value output fields back to correct input expression.
• Fix flaky test: TestBrutalShutdown.testQueryRetryOnShutdown #24808 (Author: Zac Blanco): Fix flaky test: TestBrutalShutdown.testQueryRetryOnShutdown
  • REMOTE_BUFFER_CLOSE_FAILED is now a retriable error.

All Commits

• e24a101 Add github action to prepare stable release (Add github action to prepare stable release  #24697) (Li Zhou)
• 4eb4ce2 Utilized columns fix for views (Utilized Columns fix for views #24638) (Kevin Tang)
• d5c285e Fix flaky test in TestMemoryRevokingScheduler (wangd)
• 34e068c Add requestDataSizesMaxWaitSec to Prestissimo system configs (Add requestDataSizesMaxWaitSec to Prestissimo system configs #24774) (Add requestDataSizesMaxWaitSec to Prestissimo system configs #24774) (HeidiHan0000)
• 54d192b Use java matrix for arrow-flight tests (Zac Blanco)
• 6c24d44 Fix flaky test: TestBrutalShutdown.testQueryRetryOnShutdown (Zac Blanco)
• 4f3da06 Adding e2e tests for the native Arrow Flight connector (Bryan Cutler)
• 350fdac [native] Add Arrow Flight Connector (Rijin-N)
• bea0918 [native] Pass extraCredentials to connector session properties (Deepak Majeti)
• 1db8f12 Utilized column analyzer unnest fix map case (Utilized column analyzer unnest fix map case #24789) (Kevin Tang)
• 94d6def Reduce resource utilization in TestHiveIntegrationSmokeTest (Zac Blanco)
• b15ab22 Update map_top_n_values description (Xiao Du)
• f8f2962 Remove airlift:http-client from presto-main-base (Zac Blanco)
• 47a7080 Split maven modules with dependency on jetty http server (Zac Blanco)
• 50d79c6 Refactor ExchangeClient to use RpcShuffleClientProvider (Zac Blanco)
• d1d6a3b Updated MySql version to support arm64 architecture (Nivin C S)
• 718cd5d Add admin/grafana.rst to documentation (Steve Burnett)
• fef0165 Add ConnectorMetadata.commitPageSinkAsync hook for ConnectorDeleteTableHandle (Add ConnectorMetadata.commitPageSinkAsync hook for ConnectorDeleteTableHandle #24783) (Gary Helmling)
• 4f17e4c [native] Remove unused file from protocol generation (Christian Zentgraf)
• 68cdacd Add a native type manager (Pratik Joseph Dabre)
• 3532782 Add UnknownTypeException and an error code UNKNOWN_TYPE (Pratik Joseph Dabre)
• d840d84 [native] Introduce module presto-native-tests (Pramod Satya)
• b4a4b83 Refactor testcases for presto-native-tests (Pramod Satya)
• 266069c upgrade prismjs (Shahad)
• 7673fff [native] Advance Velox (aditi-pandit)
• caf1da9 [Parquet]Close and re-create ValuesWriters after row group flush (wangd)
• 7ea4a75 Remove shadowing field held by subclasses of PrimitiveValueWriter (wangd)
• 21bdd48 Fix MV mapping ([native] Fix MV mapping #24787) (Jiaqi Zhang)
• b175123 Followup multiple eventlistener plugin changes (Fix tests). (Prashant Sharma)
• 92ed6f6 [native] Map kUnsupportedInputUncatchable to not supported error code. (Amit Dutta)
• 491a428 Move Presto on Spark page to Administration and refine details (dnskr)
• 1332125 MV refresh protocol mapping ([native] Add materialized view refresh to protocol #24780) (Jiaqi Zhang)
• b910612 [native] Fix RowExpressionTest.castToVarchar (Amit Dutta)
• 050f592 [native] Advance velox. (Amit Dutta)
• d346820 [native] Throw velox_unsupported error when try_cast of varchar is not supported. (Amit Dutta)
• 16faeaf [Iceberg]Refactor validation for SHOW CREATE TABLE for relevant tests (wangd)
• a520d92 Add new memory arbitration failure error code name (Jialiang Tan)
• 7cdf95b Apply missing presto_protocol changes from prior commits (Gary Helmling)
• 212d4ac Add ConnectorDeleteTableHandle to ConnectorProtocol (Add ConnectorDeleteTableHandle to ConnectorProtocol #24721) (Gary Helmling)
• 9490b2d [native] Advance Velox (aditi-pandit)
• b2f734a Fix return type for fnv1_32 and fnv1a_32 functions (Artem Selishchev)
• 8acca15 Add spill related configs to system configs (Add spill related configs to system configs #24726) (Add spill related configs to system configs #24726) (HeidiHan0000)
• 1ee49a4 [native] Update CI container image (Deepak Majeti)
• 07c31ab Upgrade org.apache.calcite dependency to address CVE-2023-2976 (sumi)
• e591b21 [native] Map velox and presto spill failure error code. (Amit Dutta)
• 33fca0d [native] Advance velox. (Amit Dutta)
• 872891e Refactor to use ColumnMetadata builder (Reetika Agrawal)
• 7dc32b4 Revert "Improve the merging of operator stats" (Revert "Improve the merging of operator stats" #24750) (Shang Ma)
• 7bee8b3 Remove native Presto-on-Spark (Zac Blanco)
• eaa080a Avoid using BasicPrincipal from airlift:http-server (Zac Blanco)
• b4a5f8f Add overflow detection to IntervalYearMonthOperators (Tim Meehan)
• cff865e Fix flaky test: TestIcebergHiveStatistics.testStatisticsCachePartialEviction (Zac Blanco)
• fa53b84 Fix formatting in presto_cpp/properties.rst (Steve Burnett)
• 99661b2 [Doc]Supplement the supported types for iceberg partition transforms (wangd)
• aa611c8 [Iceberg]Add test cases for transforms not yet supported on some types (wangd)
• 5ef4a76 Fix duplicate class and dependency problem (Chandrashekhar Kumar Singh)
• d87438d [native] Advance velox. (Amit Dutta)
• b5ed4d6 [codemod] Remove unused private from github/presto-trunk/presto-native-execution/presto_cpp/main/http/filters/InternalAuthenticationFilter.h +1 (Richard Barnes)
• 446afa2 Specify code block syntax (dnskr)
• 90ec198 Move benchmark driver page to Administration and refine installation steps (dnskr)
• a3966ad Add test for async data cache API on node (Reetika Agrawal)
• 73595be Dynamically compute node memory based on configured spark executor memory (Dynamically compute node memory based on configured spark executor memory #24714) (Arjun Gupta)
• 665d6ad Fix Iceberg documentation for manifest caching (Reetika Agrawal)
• 8183786 Fix Sorted Tables header in iceberg document (Reetika Agrawal)
• 72c2671 Handle listTables for non-existing schema in IcebergNativeMetadata (Reetika Agrawal)
• ecdce82 [Iceberg]Standardized type name for timestamp with and without tz (wangd)
• 4c3400a [native] Advance Velox (aditi-pandit)
• 79612f4 Fix path filtering for matrix jobs (Zac Blanco)
• 06c8e35 Update json_extract to produce canonicalized output (fix Update json_extract to Produce Canonicalized Output #24614) (XiaoDu)
• fe9db6c Enhance router UI (auden-woolfson)
• edb4b53 Upgrade Okie to version 3.6.0 (from 1.17.2) and OkHttp jar to version 4.12.0 to address CVE-2023-3635. (Mariam Almesfer)
• 1351b4a Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• 556881b Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• a4586be Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• 2d7ecb1 Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• 705c0a9 Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• 78e84be Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• d05e894 Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• cecc8cd Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• c2d973b Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• 5b7ea0e Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• 243231c Update presto-docs/src/main/sphinx/presto_cpp/properties.rst (tanjialiang)
• b4ce0ed Add missing shared arbitrator configs (Jialiang Tan)
• d260ff5 [Iceberg] deprecate some table property names (Zac Blanco)
• 7f0f4e1 Support multiple event listener plugins (Nidhin Varghese)
• 5d10c2a Add additional memory error categorization for prestissimo (Jialiang Tan)
• fa9a268 [native] Advance velox. (Amit Dutta)
• d2ac312 Add DeleteNode to presto_protocol serialization (Gary Helmling)
• 3f99d9c Make OutputBuffers Thrift-compatible (Make OutputBuffers Thrift-compatible #24701) (Shang Ma)
• 8f487f6 Upgrade io.grpc library to 1.70.0 (Dilli-Babu-Godari)
• e98ef49 Remove reload4j dependency in response to WS-2022-0467 (Shahim Sharafudeen)
• 8ef0071 Upgrade aws-java-sdk version to 1.12.782 in response to CVE-2024-21634 (Shahim Sharafudeen)
• 22acbde Ensure readability of plan printer and add test (Ensure readability of plan printer and add test #24710) (Shang Ma)
• 6c36be4 Convert DateTime to long type along the critical path within coordinator (Convert DateTime to long along the critical path within coordinator #24673) (Shang Ma)
• 3e05940 Include Table Metadata in Operator Logs (Include Table Metadata in Operator Logs #24590) (Matt Karrmann)
• 838e358 [native] fix typo in exchange request counter (Ke)
• d05ee8f [native] Advance velox. (Amit Dutta)
• a3843f6 Add JDK 17 build support (Anant Aneja)
• ee6e83d Upgrade Kafka version to 3.9.0 (Anant Aneja)
• 5d66959 Add manifest caching to iceberg connector (Zac Blanco)
• 95845fb Fix check_access_control_on_utilized_columns_only for CTE (Rebecca Schlussel)
• 144105d Upgrade sphinx to 8.2.1 and sphinx-immaterial to 0.13.0 (dnskr)
• d53d8e4 [native] remove native prefix for native connector session property (Ke)
• 348e991 Support HDFS and S3 path as warehouse directory for Hive file metastore (wangd)
• 9d46add Fix silent overflow in DateTimeEncoding.pack (Kevin Wilfong)
• 6ee450c Revert DataSize change for public-facing API (Revert DataSize change for public-facing API #24682) (Shang Ma)
• c29b385 Support Hudi merged view file slices for partition path updates without compaction (Sagar Sumit)
• cb73e99 Upgrade netty version to 4.1.118.Final to resolve CVE-2025-25193 (inf)
• 6d23641 Convert DataSize for presto-spark (Shang Ma)
• 28da88d Convert DataSize for tests (Shang Ma)
• 0711cfa Convert DataSize for other files in presto-main (Shang Ma)
• 369deb7 Convert DataSize for operator (Shang Ma)
• f6049e1 Convert DataSize for execution (Shang Ma)
• 7458b52 Convert DataSize for APIs (Shang Ma)
• 1623acc Convert DataSize for cpp worker (Shang Ma)
• d930d69 Convert DataSize for UI (Shang Ma)
• 7537e2a Upgrade json-smart version to 2.5.2 in response to CVE-2024-57699 (Shahim Sharafudeen)
• 5b7748d Upgrade asm dependencies (Shahim Sharafudeen)
• 29837ef Move IndexSourceNode to the SPI (Rebecca Schlussel)
• e2fdc66 Put event loop behind a toggle (Put event loop behind a toggle #24668) (Shang Ma)
• 2d08ffb [native] Advance velox. (Amit Dutta)
• cc35085 Fix the dropdown menu style in WorkerTrhead (Yihong Wang)
• 55a935b Refactor log4j-core and log4j-api dependencies out of root POM (Dilli-Babu-Godari)
• 3c8d5ef Remove not working command from README.md (unidevel)
• 33f4371 Fix the lint errors (unidevel)
• 79ae086 Enable welcome page for UI path /ui/dev (unidevel)
• 3a162d5 Add separate build/serve command for query_viewer_spa page (unidevel)
• 64c0e38 Record presto exchange source request duration and num of retries (Ke)
• 74c0411 Changed delta connector API in documentation (Hazmi)
• 7515e42 Move velox ahead and fix tests. (Krishna Pai)
• 5e1f28f Fix the links on the doc page for the 0.291 release (dnskr)
• bd01f3d Add documentation for cache configuration properties (Minhan Cao)
• 1d58bca Align format for section headers in the documentation (dnskr)
• ba3230f Add links from lakehouse connector docs to file-based metastore (Steve Burnett)
• 9d1cc51 [native] Advance velox. (Amit Dutta)
• 27469d0 Add registerProperty back for fbcode usage (Add registerProperty back for fbcode usage #24653) (vhsu14)
• 9029592 [Iceberg] rename "target_split_size" to "target_split_size_bytes" (Zac Blanco)
• f6c9750 [native] Default task.max-drivers-per-task to hardware concurrency (Deepak Majeti)
• ed8584f [native] Include storageParameters in HiveConnectorSplit (Zac Wen)
• 8930308 [native] Add queuedTimeInNanos in task stats (Ke)
• f7103fe [native] Fix presto_cpp includes ([native] Fix includes #24625) (Joe Giardino)
• 40fe92e [native] Add LinuxMemoryChecker check/warning to ensure system-mem-limit-gb is reasonably set (Minhan Cao)
• bd29a38 [native] Advance Velox (aditi-pandit)
• 2a99af4 Add tracking of analysis time (Anant Aneja)
• 2a0999a Move file-based metastore doc to installation/deployment.rst (Steve Burnett)
• 321a196 Add native prefix to hive session property (Ke)
• 75dce51 [Iceberg]Support setting warehouse data directory for Hadoop catalog (wangd)
• fe97297 [Iceberg]Enable setting separate data write location on table creation (wangd)
• 56bf5e6 Add hive session property to disable stats based filter reordering (Ke)
• 0927c8f [Iceberg] Enable affinity scheduling on file sections (Zac Blanco)
• f9caa39 Move Tableau page to Clients menu (dnskr)
• c14f8b4 fix(iceberg): Date partition value parse issue (Mahadevuni Naveen Kumar)
• 8485839 [native] Fix custom type headers in unit tests (Kevin Wilfong)
• 841932c Correct catalog name for iceberg tests (Reetika Agrawal)
• 77d55e9 Add troubleshooting topic to documentation (Steve Burnett)
• 7088216 [codemod] Deshim //folly/experimental:threaded_repeating_function_runner in fbcode (Nicholas Ormrod)
• e5a1d91 Move Java page to Clients menu and fix references (dnskr)
• bd095dc Consolidate Presto CLI documentation on clients/presto-cli.rst page (dnskr)
• abb3399 [native] Advance velox. (Amit Dutta)
• e57c252 Add ConnectorDeleteTableHandle to support DELETEs (Shelton Cai)
• 4b8271c [native] Support specification of node pool type in announcer (jay.narale)
• b12e90d Upgrade org.apache.ratis dependency to address CVE-2020-15250 (Sumi Mathew)
• d6bc3e2 [native] Advance Velox (Kevin Wilfong)
• 95dc155 Add documentation to note "-gb" Prestissimo Configs are using GiB units and not gB units (Minhan Cao)
• 0041846 Fix approx_percentile to have constant pct for input rows (Fix approx_percentile to have constant pct for input rows #24600) (Yuanda (Yenda) Li)
• e2ee434 Add checkQueryIntegrity to DispatchManager and Add schema/catalog to AccessControlContext (Kevin Tang)
• 15afc5c Use builder pattern for IcebergQueryRunner (Zac Blanco)
• a766a3a Revert "Assign event loop to tasks and run methods from a task in the same event loop" (Shang Ma)
• d6ce440 Revert "Use a safe eventLoop wrapper to avoid thread shutdown and fail the task correctly" (Shang Ma)
• 84efc90 Add config property 'tpcds.use-varchar-type' (Pratik Joseph Dabre)
• 0c546f7 [native] Advance Velox (aditi-pandit)
• ea7dfa8 Update error code for checkElementNotNull used in array comparison operators (Update the error type for ARRAY_NULL_ELEMENT_MSG #24570) (XiaoDu)
• d6c5af6 Upgrade libthrift to 0.14.1 due CVE-2020-13949 (Denodo Research Labs)
• 4a0bbc9 Subclass FileHiveMetastore for Iceberg connector (wangd)
• d7c0930 Improve boostrap log to expose the wrong classLoader (Improve boostrap log to expose the wrong classLoader #24533) (Eric Liu)
• db0fe87 Add bootstrap icon to the vendor folder (Yihong Wang)
• 9c4b683 Fix dropdown style and diagram text alignment (unidevel)
• c1ec5a7 [Iceberg] Session property for target split size (Zac Blanco)
• 8accda9 [native] Add support for ORC reader and add orc native tests (wypb)
• 7bdad6d Pass ConnectorSession to PlanChecker.validate (Rebecca Schlussel)
• 4435387 Add forConnectorId method to ConnectorSession (Rebecca Schlussel)
• d6b494a Fix failing variadic functions when sidecar is enabled (Pratik Joseph Dabre)
• 2ec7613 fixed view uuid type parsing (ajay-kharat)
• 704bcc9 Fix formatting in properties.rst and base-arrow-flight.rst (Steve Burnett)
• 700fdc7 [native] Advance velox. (Amit Dutta)
• db92976 [Iceberg]Support renaming table on hive file catalog (wangd)
• 652026b add mysql compatible function bit_length (shenh062326)
• 03b8cd9 Make event loop thread number configurable (Shang Ma)
• 6f16d8c Update presto-verifier/src/main/java/com/facebook/presto/verifier/framework/VerifierConfig.java (Sergey Pershin)
• 88ee973 Add 'use-test-checksum-in-determinism-analyzer' config property to Verifier. (Sergey Pershin)
• 6f09c57 Add support to disable task update size tracking (Nikhil Collooru)
• b190fe8 Remove synchronization for updateFinalTaskInfo() (Nikhil Collooru)
• 99ea15b Add Join PrestoDB on Slack link on doc pages (Yihong Wang)
• 089fcf8 Fix GH Actions for doc-only PR (Yihong Wang)
• d08c27e Fix duplicate TABLE_TYPE listing for view from system.jdbc.tables (Reetika Agrawal)
• ddb5bae Fix enhanced_scheduling_property name (jaystarshot)
• c85d3d3 Upgrade log4j-core and log4j-api dependencies (Dilli-Babu-Godari)
• 7d69b0a [native] Advance velox. (Amit Dutta)
• 1f61957 Record http client transaction create delay time (Ke)
• 1c43927 Package all resources into query_view_spa.html (Package all resources into query_view_spa.html #24486) (Li Zhou)
• 0370282 Arrow Flight module - do not bind class to itself (ArrowFlight module - do not bind class to itself #24540) (Elbin Pallimalil)
• 18cef11 Add documentation for file-based metastore (Steve Burnett)
• b835409 Upgrade bootstrap and jquery for single page app (Yihong Wang)
• e2571ab Update presto console docs (Shahad)
• 2d830a3 add signature index and event type for type safety (Shahad)
• 37a1f58 fix(dependencies): switch from dagre-d3 to dagre-d3-es (Shahad)
• 77b64b0 Added data sanitization to queryId and nodeId, along with encodeURIComponent to queryId & nodeId. (Shahad)
• bc90e93 Check if event ID exists before processing and prevent child events (Shahad)
• 0c3cdd4 Update stage navigation to match selected plan event (Shahad)
• ecc8faa Fix issue with Node details not showing on Stage page (Shahad)
• 859ed50 Fixes: security issues for webapp jquery and bootstrap (Shahad)
• 2c5f929 Fix compilation failure after merging AddExchangeBeforeGroupId (Zac Blanco)
• e84e4d2 Add Exchange before GroupId to improve Partial Aggregation (Anant Aneja)
• 828e81f Add Lateral join support in sql/select.rst (Steve Burnett)
• 099bd42 [native] Derive TableScan stream type as FIXED (Andrii Rosa)
• 924d309 Make ArrowFlightConfig verifyServer true by default (Bryan Cutler)
• 1a0c891 Adjust testing Arrow connector name to arrow-flight (Bryan Cutler)
• 3b5a705 Use setup-java@v4 parameter for CI dep caching (Zac Blanco)
• 504184a Upgrade to actions/setup-java@v4 (Zac Blanco)
• 11adb6e [iceberg] Reformat incorrectly formatted files (Zac Blanco)
• 28efed3 [native] Advance velox. (Amit Dutta)
• a0f2ccb re-add deleted subtraction test (librian415)
• d4417e4 remove leftover (librian415)
• ff20e13 lint (librian415)
• 9bf42cb [Presto-Main] Add long overflow checks for IntervalDayTime (librian415)
• 7882d83 Add @czentgr as module committer for CI (Add @czentgr as module committer for CI #24519) (Timothy Meehan)
• 2005b0b Add support for UPDATE in iceberg (Zac Blanco)
• 4e3cf23 Prevent exception when no input for update (Zac Blanco)
• 0299a29 [native] Allow options for wget and tar commands during setup (Shakyan Kushwaha)
• f02046f Avoid creating expensive Path objects in split creation code (Nikhil Collooru)
• 003d86a Add Support for Iceberg table sort orders (Nidhin Varghese)
• 069a16f Remove duplicate mapping from iceberg docs (auden-woolfson)
• 8789cd9 Upgrade commons-text dependency to address CVE-2024-47554 (Upgrade the jar org.apache.commons:commons-text:1.10.0 to 1.13.0 #24467) (sumi-mathew)
• 4615d43 [native] Advance velox. (Amit Dutta)
• 16b447b [iceberg] Fix StatisticsFileCache JMX bean (Zac Blanco)
• 53da02f [iceberg] Fix bug on StatisticsFileCache miss (Zac Blanco)
• 744f1bb [native] Trigger presto-native-sidecar-plugin test workflow when changes occur (Pratik Joseph Dabre)
• a6d82fe [native] Add clang installation to dependency image and update image (Christian Zentgraf)
• 673c80f [native] Detect companion functions from velox function metadata (Pramod Satya)
• 391541a Add operator override for xxhash64, combine_hash internal functions ([native]: Add operator override for xxhash64, combine_hash internal functions #24503) (Pradeep Vaka)
• f6ffef0 Upgrade airbase and presto-maven-plugin (Upgrade airbase and presto-maven-plugin #24357) (Zac Blanco)
• 7119aa2 Update security protocol to TLS (Shahim Sharafudeen)
• 903520c Upgrade cache Github action to v4 (Pramod Satya)
• 02f8f9f [native] Add a config property for excluding invalid worker session properties (Pratik Joseph Dabre)
• be5fe8c [native] Update include for ConfigTest.cpp (Amit Dutta)
• 1b51466 Update Presto version in example command (Steve Burnett)
• 6438c4a [native] Advance velox and fix unit tests. (Amit Dutta)
• 81e31fe Fix typo in clients/go.rst and js.rst (Steve Burnett)
• a0c9b23 Update pull_request_template.md to remove PR link examples (Steve Burnett)
• a7f6cfe Add JavaScript client to documentation (Steve Burnett)
• 1176ffd Fix getting views for Hive metastore (Sayari Mukherjee)
• 928fdb3 [native] Switch to use Clang for the Linux debug build in the CI (Christian Zentgraf)
• a8a6ffd Fix build failure on JDK 11 (Zac Blanco)
• dbc1c15 Add new error code for queries killed due to too many tasks on cluster (Patrick Sullivan)
• a7a7f80 Expose getting base directory (Yuanda (Yenda) Li)
• d4c632a [native] Advance velox. (Amit Dutta)
• e4be876 Add OpenAPI documentation for /v1/functions (Pratik Joseph Dabre)
• 552cd86 [native] Integrate SPI with sidecar and add e2e native function validation tests (Pratik Joseph Dabre)
• f54c498 [native] Introduce native function namespace SPI (Pratik Joseph Dabre)
• 092dd36 Change built-in namespace to JAVA_BUILTIN_NAMESPACE (Pratik Joseph Dabre)
• c34b63a Add a new module presto-function-namespace-managers-common (Pratik Joseph Dabre)
• 55060ed [native] Add additional function metadata to function signatures endpoint (Pratik Joseph Dabre)
• 54de1aa Add utility functions to resolve intermediate type in generic aggregate functions (Pratik Joseph Dabre)
• 543b48e [native] Add presto.default-namespace Prestissimo config property (Pratik Joseph Dabre)
• 719bfe2 [native] Fix varchar cast for json ([native] Fix varchar cast for json #24396) (Natasha Sehgal)
• 14063ed Add support for loading plugins in the function server (Abe Varghese)
• 892ad68 Upgrade accumulo to 1.10.1 to fix CVE-2020-17533 (namya28)
• ec9e904 Add support for timestamps with timezone in iceberg type converter (auden-woolfson)
• dd1893c Add reference REST function server (Abe Varghese)
• 8041eb5 Add REST based Function Namespace Manager (Abe Varghese)
• 6aca572 upgrading hive-dwrf version to 0.8.7 (namya28)
• 08fe81c Revert " Upgrade Okie to version 3.6.0 and OkHttp to version 4.12.0" (Andrii Rosa)
• 4464129 Adding Arrow Flight connector template (Arrow Flight Connector Template #24427) (Bryan Cutler)
• c229714 Use ExpressionOptimizerProvider (Tim Meehan)
• 51ae5a5 Add ExpressionOptimizerManager (Tim Meehan)
• d477ea1 Add SPI to customize expression optimization (Tim Meehan)
• fd10129 [native] Suppress connector values from being logged (Christian Zentgraf)
• 0d85483 [native] Add missing catalog configurations to docker image (Christian Zentgraf)
• 373a1d7 Record CPU time on various planning stages (Andrii Rosa)
• af6399a Avoid batch reading of nested decimals as this reader is not implemented (Avoid batch reading of nested decimals as this reader is not implemented #24440) (Denodo Research Labs)
• e223cc1 [native]Switch to use subfiled filters in dwio common (Xiaoxuan Meng)
• 510024d Improve the merging of operator stats (Shang Ma)
• 3f4e4c3 Update git config and environment in the presto stable release pipeline (Update git config and environment in the presto stable release pipeline #24441) (unidevel)
• 01bdab4 Upgrade Okie to version 3.6.0 and OkHttp to version 4.12.0 (Mariam AlMesfer)
• 3da462f [native]Reference hive connector util for subfield filter (Xiaoxuan Meng)
• 55fe797 [Iceberg]Fix jmx metrics overwrite each other between nodes in query runner (wangd)
• bbf20b5 Add python and go to /clients ([docs] Add python and go to /clients #24425) (Steve Burnett)

[linux-foundation-easycla]

The committers listed above are authorized under a signed CLA.

• ✅ login: ZacBlanco / name: Zac Blanco (2931361)

[steveburnett]

In my first review of the 0.292 release notes draft, I:

• tested all links, and fixed broken or badly-formatted links
• suggested rephrasing to follow the Order of changes in the Release Note Guidelines
• fixed minor capitalization and punctuation
• made some suggestions of rephrasing not related to the Order of changes

What I did not do:

• review the Missing Release Notes to determine if any PRs need release notes written and added to this document.
• move and reorder topics, and entries within topics, to align with the Order of changes and the Order of sections in the Release Notes Guidelines. I made comments suggesting where I think these changes need to be made.
• select notable release note entries from this release to copy into the Highlights topic at the beginning.

[steveburnett]

Thanks for adding release note entries from the missing release notes!

[steveburnett]

Thanks for the update! Responses to your comments with hopefully better suggestions.

Can you reorder the sections to follow the Order of sections in the Release Notes Guidelines? For this release, I think that would look like this:

General
Prestissimo (Native Execution)
Security
connectors (by alphabetic order for the connectors)
SPI

[steveburnett]

Thanks! Did a complete review of the document, and I hope this should be everything before the Highlights.

[steveburnett]

LGTM! (docs)

Pull updated branch, new local dc build, looks good. Thanks for all the quick work!