Add release notes for 0.293

[unidevel]

Missing Release Notes

Amit Dutta

• Add cosine_similarity function for two arrays prestodb/presto#25056 Add cosine_similarity function for two arrays (Merged by: Amit Dutta)
• [native] Advance velox. prestodb/presto#24823 [native] Advance velox. (Merged by: Amit Dutta)

Emily (Xuetong) Sun

• Support sorted shuffle write in Sapphire-Velox stack prestodb/presto#24739 Support sorted shuffle write in Sapphire-Velox stack (Merged by: Facebook Community Bot)

Gary Helmling

• [native] Add DeleteNode translation to TableWriteNode in Velox query plan prestodb/presto#24772 [native] Add DeleteNode translation to TableWriteNode in Velox query plan (Merged by: Gary Helmling)

HeidiHan0000

• Add request-data-sizes-max-wait-sec to session properties prestodb/presto#24918 Add request-data-sizes-max-wait-sec to session properties (Merged by: HeidiHan0000)
• Add system configs to query configs mapping for requestDataSizesMaxWaitSec prestodb/presto#24977 Add system configs to query configs mapping for requestDataSizesMaxWaitSec (Merged by: Ke)

Heng Xiao

• Fix RedisProviderPlugin cannot be instantiated using reflection in Pl… prestodb/presto#24835 Fix RedisProviderPlugin cannot be instantiated using reflection in Pl… (Merged by: Jay Narale)

Jacob Khaliqi

• Change array_top_n to return null on bad n prestodb/presto#24729 Change array_top_n to return null on bad n (Merged by: Aditi Pandit)

Prashant Golash

• [presto] Add state filter to the queryState resource prestodb/presto#24856 [presto] Add state filter to the queryState resource (Merged by: Rebecca Schlussel)
• [presto][ui] Display queued queries per subgroup RG prestodb/presto#24830 [presto][ui] Display queued queries per subgroup RG (Merged by: Yihong Wang)

Pratik Joseph Dabre

• [native] Add longVariableConstraints to function metadata prestodb/presto#24759 [native] Add longVariableConstraints to function metadata (Merged by: Pratik Joseph Dabre)

Samuel Majoros

• Add longest_common_prefix implementation, documentation and tests prestodb/presto#24891 Add longest_common_prefix implementation, documentation and tests (Merged by: Steve Burnett)

Shijin

• Changes to enable ssl/tls in hms prestodb/presto#24745 Changes to enable ssl/tls in hms (Merged by: Ying)

Xiao Du

• revert json_extract to Produce Canonicalized Output prestodb/presto#24864 revert json_extract to Produce Canonicalized Output (Merged by: XiaoDu)

Yuanda (Yenda) Li

• [native] Save 1 memcpy in parsing message body prestodb/presto#24941 [native] Save 1 memcpy in parsing message body (Merged by: Yuanda (Yenda) Li)

aditi-pandit

• Add team-velox as code owners for presto-native-(sidecar-plugin|tests) modules prestodb/presto#24862 Add team-velox as code owners for presto-native-(sidecar-plugin|tests) modules (Merged by: Aditi Pandit)

namya28

• Upgrading mysql jar in presto prestodb/presto#24754 Upgrading mysql jar in presto (Merged by: Reetika Agrawal)

tanjialiang

• [native] Add session property for eager streaming aggregation flush prestodb/presto#24947 [native] Add session property for eager streaming aggregation flush (Merged by: tanjialiang)
• Add shared-arbitrator.memory-pool-abort-capacity-limit into property registry prestodb/presto#24915 Add shared-arbitrator.memory-pool-abort-capacity-limit into property registry (Merged by: tanjialiang)
• Add distinct to the right side when LOJ + IS NULL is rewritten to Semijoin prestodb/presto#24884 Add distinct to the right side when LOJ + IS NULL is rewritten to Semijoin (Merged by: tanjialiang)
• Add memory pool debug regex prestodb/presto#24833 Add memory pool debug regex (Merged by: tanjialiang)

Extracted Release Notes

• Fix rollback after statement fail in non-autocommit transaction prestodb/presto#23247 (Author: wangd): Fix rollback after statement fail in non-autocommit transaction
  • Fix ROLLBACK statement to ensure it successfully abort non-auto commit transactions corrupted by failed statements.
• Fix ARRAYS_OVERLAP function bug prestodb/presto#23845 (Author: Hazmi): Fix ARRAYS_OVERLAP function bug
  • Fix a bug where a mirrored :func:arrays_overlap(x, y) -> boolean function does not return the correct value.
• Upgrade elasticsearch connector from 6 to 7 prestodb/presto#23894 (Author: Hazmi): Upgrade elasticsearch connector from 6 to 7
  • Upgrade elasticsearch to 7.17.27 in response to CVE-2024-43709 <https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2024-43709>_.
• Add config to specify metastore catalog name prestodb/presto#24235 (Author: Anurag Dwivedi): Add config to specify metastore catalog name
  • Add configuration property hive.metastore.catalog.name to pass catalog names to the metastore, enabling catalog-based schema management and filtering.
• Add support for row filtering and column masking access control prestodb/presto#24277 (Author: Bryan Cutler): Add support for row filtering and column masking access control
  • Add support for row filtering and column masking in access control.
• Add support for SHOW CREATE SCHEMA prestodb/presto#24356 (Author: Reetika Agrawal): Add support for SHOW CREATE SCHEMA
  • Add DDL SQL support for SHOW CREATE SCHEMA.
• Update zookeeper version to fix CVEs prestodb/presto#24403 (Author: Shijin): Update zookeeper version to fix CVEs
  • Upgrade zookeeper to 3.9.3 to fix security vulnerability in presto-accumulo, presto-delta,presto-hive,presto-kafka and presto-hudi in response to CVE-2023-44981 <https://nvd.nist.gov/vuln/detail/cve-2023-44981>_.
• Add authentication layer to presto router prestodb/presto#24407 (Author: auden-woolfson): Add authentication layer to presto router
  • Add authentication capabilities to Presto router.
• Custom scheduler plugin support prestodb/presto#24439 (Author: jp-sivaprasad): Custom scheduler plugin support
  • Add support for custom scheduler plugin.
  • Add example custom scheduler plugin - Metrics based custom scheduler plugin.
• Add health check to route queries to healthy cluster and router jmx counter updates prestodb/presto#24449 (Author: auden-woolfson): Add health check to route queries to healthy cluster and router jmx counter updates
  • Add coordinator health checks to Presto router.
  • Add counter JMX metrics to Presto router.
• [native] Add S3 metrics reporting prestodb/presto#24554 (Author: Xin Zhang): [native] Add S3 metrics reporting
  • Add runtime metrics collection for S3 Filesystem.
• Router scheduler fixes and unit test case enhancements prestodb/presto#24580 (Author: jp-sivaprasad): Router scheduler fixes and unit test case enhancements
  • Fix Router Round robin scheduler candidate cluster index, by adding group specific index.
• Enhance S3 Web Identity authentication & security mapping prestodb/presto#24645 (Author: Sayari Mukherjee): Enhance S3 Web Identity authentication & security mapping
  • Add support for Web Identity authentication in S3 security mapping with the hive.s3.webidentity.enabled property.
• Upgrade plexus-utils and commons-beanutils prestodb/presto#24665 (Author: Mariam Almesfer): Upgrade plexus-utils and commons-beanutils
  • Upgrade commons-beanutils to version 1.9.4 in response to CVE-2014-0114 <https://nvd.nist.gov/vuln/detail/CVE-2014-0114>_.
  • Upgrade plexus-utils to version 3.6.0 in response to CVE-2017-1000487 <https://nvd.nist.gov/vuln/detail/cve-2017-1000487>_.
• Add compression codec support for PageSerde prestodb/presto#24670 (Author: Xin Zhang): Add compression codec support for PageSerde
  • Replace exchange.compression-enabled, fragment-result-cache.block-encoding-compression-enabled, experimental.spill-compression-enabled with exchange.compression-codec, fragment-result-cache.block-encoding-compression-codec to enable compression codec configurations. Supported codecs include GZIP, LZ4, LZO, SNAPPY, ZLIB and ZSTD.
• Upgrade sqlserver driver to version 12.8.1 prestodb/presto#24686 (Author: lukmanulhakkeem): Upgrade sqlserver driver to version 12.8.1
  • Upgraded SQL Server driver to version 12.8.1 to support NTLM authentication. See :ref:connector/sqlserver:authentication for more details.
  • Note: Starting from this version, the driver sets the encrypt property to true by default. If you are connecting to a non-SSL SQL Server instance, you must explicitly set encrypt=false in your connection configuration to avoid connectivity issues. This is a breaking change for existing connections.
• Use Java built-in functions to create failure function prestodb/presto#24792 (Author: Pratik Joseph Dabre): Use Java built-in functions to create failure function
  • Replace using native functions with Java functions for creating failure functions when native execution is enabled.
• [Hive] Use S3 listObjectsV2 in PrestoS3FileSystem listPrefix prestodb/presto#24794 (Author: Deepak Mehra): [Hive] Use S3 listObjectsV2 in PrestoS3FileSystem listPrefix
  • Replace listObjects with listObjectsV2 in PrestoS3FileSystem listPrefix.
• Add support for optional kafka SASL prestodb/presto#24798 (Author: Shahim Sharafudeen): Add support for optional kafka SASL
  • Add support for optional Apache Kafka SASL.
• Pass full session to avoid Unknown connector errors prestodb/presto#24803 (Author: Denodo Research Labs): Pass full session to avoid Unknown connector errors
  • Fix to pass full session to avoid Unknown connector errors using the Nessie catalog.
• [Iceberg]Support bucket transform for TimeType prestodb/presto#24829 (Author: wangd): [Iceberg]Support bucket transform for TimeType
  • Support bucket transform for columns of type TimeType in Iceberg table.
• [Iceberg] Cache invalidation procedure for Iceberg coordinator cache prestodb/presto#24831 (Author: Reetika Agrawal): [Iceberg] Cache invalidation procedure for Iceberg coordinator cache
  • Add support for the procedure .system.invalidate_statistics_file_cache() for StatisticsFile cache invalidation in Iceberg.
  • Add support for the procedure .system.invalidate_manifest_file_cache() for ManifestFile cache invalidation in Iceberg.
• [native] Fix v1/operation/task/getDetail prestodb/presto#24839 (Author: Deepak Majeti): [native] Fix v1/operation/task/getDetail
  • Fix REST API call v1/operator/task/getDetails?id= crash.
• [native] Remove register-test-functions worker config prestodb/presto#24853 (Author: Pramod Satya): [native] Remove register-test-functions worker config
  • Removes worker config register-test-functions.
• Add sidecar and sidecar plugin documentation prestodb/presto#24883 (Author: Pramod Satya): Add sidecar and sidecar plugin documentation
  • Document Presto C++ sidecar and native sidecar plugin.
• Fix sensitive data disclosure in logs prestodb/presto#24886 (Author: Nivin C S): Fix sensitive data disclosure in logs
  • Fix the issue of sensitive data such as passwords and access keys being exposed in logs by redacting sensitive field values.
• Reduce memory usage in reader by reset all underlying readers prestodb/presto#24912 (Author: Chen Yang): Reduce memory usage in reader by reset all underlying readers
  • Improve memory usage in reader with nested readers by resetting all nested readers.
• Add NativeExecutionTypeRewrite prestodb/presto#24916 (Author: Zac Wen): Add NativeExecutionTypeRewrite
  • Add type rewrite support for native execution. This feature can be enabled by native-execution-type-rewrite-enabled configuration property and native_execution_type_rewrite_enabled session property. :pr:24916.
• Timeout reading delta tables after incremental updates with null values prestodb/presto#24920 (Author: Miguel Blanco Godón): Timeout reading delta tables after incremental updates with null values
  • Fix a bug where after an incremental update with null values is made reads start timing out.
• Re-introduce improving the merging of operator stats prestodb/presto#24921 (Author: Shang Ma): Re-introduce improving the merging of operator stats
  • Improve how we merge multiple operator stats together.
  • Improve metrics creation by refactoring local variables to a dedicated class.
• Check Query integrity in Analyzer Util prestodb/presto#24927 (Author: Kevin Tang): Check Query integrity in Analyzer Util
  • Improve ACL check by moving checkQueryIntegrity from Dispatch phase to Analyzer phase.
• Support sorted shuffle write in Sapphire-Velox stack prestodb/presto#24953 (Author: Emily (Xuetong) Sun): Support sorted shuffle write in Sapphire-Velox stack
  • Add supported for sort in PartitionAndSerialize operator.
• Use VectorFuzzer for BinarySortableSerializer test prestodb/presto#24954 (Author: Emily (Xuetong) Sun): Use VectorFuzzer for BinarySortableSerializer test
  • Add BinarySortableSerializer tests with VectorFuzzer.
• Add view text hash info to accessControlReferences prestodb/presto#24955 (Author: Kevin Tang): Add view text hash info to accessControlReferences
  • Add view definitions from Analyzer phase to perform full integrity check on query credentials.
  • Change checkQueryIntegrity function signature in AccessControl interface to pass in view definitions as params.
• Upgrade several dependency versions prestodb/presto#24971 (Author: Hazmi): Upgrade several dependency versions
  • Upgrade slf4j version to 1.7.36.
  • Upgrade okio-jvm version to 3.9.1.
  • Upgrade kotlin-stdlib-jdk8 to 1.9.25.
  • Upgrade netty version to 4.1.119.Final.
• [Iceberg]Prefer AppendFiles over RowDelta in insert-only statement prestodb/presto#24989 (Author: wangd): [Iceberg]Prefer AppendFiles over RowDelta in insert-only statement
  • Replace RowDelta with AppendFiles for insert-only statements such as INSERT and CTAS.
• Add support for geometry type in mysql connector prestodb/presto#24996 (Author: Mariam Almesfer): Add support for geometry type in mysql connector
  • Add support for GEOMETRY type in the MySQL connector.
• Fix: Re-initialize sort key serializer for every new input added prestodb/presto#25015 (Author: Emily (Xuetong) Sun): Fix: Re-initialize sort key serializer for every new input added
  • Fix issue with PartitionAndSerialize re-using only keys from the first batch of data.
• Make taskUpdateRequest and taskInfo classes Thrift ready with json fields prestodb/presto#25020 (Author: Shang Ma): Make taskUpdateRequest and taskInfo classes Thrift ready with json fields
  • Improve communication between coordinator and worker with thrift serde.
• Fix distributed sort parallelism for single node execution prestodb/presto#25022 (Author: Andrii Rosa): Fix distributed sort parallelism for single node execution
  • Improve performance of ORDER BY queries on single node execution :pr:25022.
• Enable access control row filters and masks for views prestodb/presto#25052 (Author: Bryan Cutler): Enable access control row filters and masks for views
  • Add support for access control row filters and column masks on views.
• [native] Migrate TaskStatus, TaskUpdateRequest, TaskInfo to Thrift with JSON fields in CPP prestodb/presto#25079 (Author: vhsu14): [native] Migrate TaskStatus, TaskUpdateRequest, TaskInfo to Thrift with JSON fields in CPP
  • Improve communication between coordinator and worker with thrift serde.
• Fix second UDF not respecting sub-minute time zone offsets prestodb/presto#25090 (Author: Kevin Wilfong): Fix second UDF not respecting sub-minute time zone offsets
  • Fix returning incorrect results from the "second" UDF when a timestamp is in a time zone with an offset that is at the granularity of seconds.
• Fix vulnerability issues on presto-redshift, commons-compress and snappy-java prestodb/presto#25106 (Author: Shahim Sharafudeen): Fix vulnerability issues on presto-redshift, commons-compress and snappy-java
  • Upgrade commons-compress version to 1.26.2 across the codebase to address 'CVE-2021-35517 GHSA-xqfj-vm6h-2x34' , 'CVE-2021-35516GHSA-crv7-7245-f45f', 'CVE-2021-36090 GHSA-mc84-pj99-q6hh', 'CVE-2021-35515 GHSA-7hfm-57qf-j43q' and 'CVE-2024-25710 GHSA-4g9r-vxhx-9pgx'.
  • Replace dependency from PostgreSQL to redshift-jdbc42 to address 'CVE-2024-1597 GHSA-24rp-q3w6-vc56', 'CVE-2022-31197 GHSA-r38f-c4h4-hqq2' and 'CVE-2020-13692 GHSA-88cc-g835-76rp'.
  • Upgrade snappy-java version at 1.1.10.4 across the codebase to address 'CVE-2023-43642 GHSA-55g7-9cwv-5qfv'.
• Fix filter source variable not found bug in left join to semi join optimizer prestodb/presto#25111 (Author: Feilong Liu): Fix filter source variable not found bug in left join to semi join optimizer
  • Fix a bug in left join to semi join optimizer which leads to filter source variable not found error.
• Remove duplicate binding in router module prestodb/presto#25150 (Author: auden-woolfson): Remove duplicate binding in router module
  • Remove unused line of code from router module.
• Run empty values node simplify optimizer after connector optimizer prestodb/presto#25155 (Author: Feilong Liu): Run empty values node simplify optimizer after connector optimizer
  • Improve query plans using the SimplifyPlanWithEmptyInput optimizer to convert a table scan which returns no data to an empty values node.
• Presto router - Add security related headers for static resources served from Presto Router UI prestodb/presto#25165 (Author: jp-sivaprasad): Presto router - Add security related headers for static resources served from Presto Router UI
  • Add security-related headers to the static resources served from the Presto Router UI, including: Content-Security-Policy, X-Content-Type-Options. See reference docs Content-Security-Policy <https://developer.mozilla.org/en-US/docs/Web/HTTP/CSP>_ and X-Content-Type-Options <https://learn.microsoft.com/en-us/previous-versions/windows/internet-explorer/ie-developer/compatibility/gg622941(v=vs.85)>_. :pr:24272.

All Commits

• 5bbdf93 [native] Remove unused includes. (Amit Dutta)
• 57a85ce [native] Advance velox. (Amit Dutta)
• c21e043 [native] Advance Velox (aditi-pandit)
• cd4321f Fix formatting in sql/show-create-schema.rst (Steve Burnett)
• bb77665 fix a build issue in presto-docs (wraymo)
• 6d896c7 [native] Use release dependency image (Deepak Majeti)
• b11f358 Update plugin to generate idl thrift file automatically (Update plugin to generate idl thrift file automatically prestodb/presto#25164) (Shang Ma)
• c1395ee Fix flaky test: TestOutputColumnTypes.testOutputColumnsForInsertAsSelect (Nidhin Varghese)
• fcc4735 Run empty values node simplify optimizer after connector optimizer (Feilong Liu)
• 484b00e Fix formatting in /functions/ (Steve Burnett)
• 274e05a Add support for geometry type in mysql connector (Mariam Almesfer)
• f9c336d [Iceberg]Explicitly close the transactions opened manually in tests (wangd)
• b566980 Add support for SHOW CREATE SCHEMA (Reetika Agrawal)
• 675e65e Use Java built-in functions to create failure function (Pratik Joseph Dabre)
• 76344ab Add Request Header Fields Too Large to /troubleshoot/ (Steve Burnett)
• 61f0387 [native] Advance Velox and Dependency Versions (Christian Zentgraf)
• c152806 Add timeouts to presto-router TestHealthChecks (Zac Blanco)
• db01390 Fix ClusterManager failing to poll (Zac Blanco)
• 6f094ae Add presto-testng-services to presto-router (Zac Blanco)
• 14da967 Presto router - Add security related headers for static resources for UI (jp-sivaprasad)
• 3ebef98 Upgrade node to 22.15.1 (Andrew Xie)
• 0979ea7 Release action fixes and improvements (Release action fixes and improvements prestodb/presto#24957) (Li Zhou)
• 9ee9d65 [sidecar] Fix ANALYZE queries on varchar columns when sidecar is enabled (Pratik Joseph Dabre)
• 4766404 Add http-server.max-request-header-size to properties.rst (Steve Burnett)
• 8286ffa [native] Add optional Task queuing framework. (Sergey Pershin)
• f419d2f Remove duplicate binding in router module (auden-woolfson)
• 8afbe05 Add per-query-retry-limit to properties.rst (Steve Burnett)
• 867bf03 Fix second UDF not respecting sub-minute time zone offsets (Kevin Wilfong)
• 60941a7 Fix vulnerability issues in postgresql, commons-compress and snappy-java (Shahim Sharafudeen)
• 5b4b71c [native] Migrate TaskStatus, TaskUpdateRequest, TaskInfo to Thrift with JSON fields in CPP ([native] Migrate TaskStatus, TaskUpdateRequest, TaskInfo to Thrift with JSON fields in CPP prestodb/presto#25079) (vhsu14)
• 9f77bed Make taskUpdateRequest and taskInfo classes Thrift ready with json fields (Make taskUpdateRequest and taskInfo classes Thrift ready with json fields prestodb/presto#25020) (Shang Ma)
• 1fc5687 [native] Fix build order issues with presto_server (Christian Zentgraf)
• 58df37d Add index join related nodes to plan matcher (Zac Wen)
• d6a136c [sidecar] Fix failing lambda test case in TestNativeSidecarPlugin (Pratik Joseph Dabre)
• be655be presto router - custom scheduler plugin (jp-sivaprasad)
• 65b832b Add Test for QualifiedObjectName Regression in 0.292 (Jim Simon)
• 3da0e14 Fix the partial aggregation pushdown for system table for native execution (Ke Wang)
• edfebc2 Fix filter source variable not found bug in left join to semi join optimizer (Feilong Liu)
• 8dd2b4c [native] Add Builder classes for custom PlanNodes (Kevin Wilfong)
• 3145f65 [sidecar] Fix array_sort lambda function failure when sidecar is enabled and add e2e lambda function tests (Pratik Joseph Dabre)
• 52fae25 Revert "Change array_top_n to return null on bad n" (Aditi Pandit)
• 65becb0 Apply filters and masks for view object (Bryan Cutler)
• 51272bf Apply filters and masks for tables referenced by views (Bryan Cutler)
• 91c2c54 Change array_top_n to return null on bad n (Jacob Khaliqi)
• dda99ba Add docs for router authentication (auden-woolfson)
• 9c70418 Add authentication layer to presto router (auden-woolfson)
• 065910a Refactor PluginManager(s) to use PluginManagerUtil (auden-woolfson)
• b5a1eb7 Fix redshift documentation (Reetika Agrawal)
• 09175f3 Fix protocol generation to properly remove license (Bryan Cutler)
• 941ffb2 Add request-data-sizes-max-wait-sec to session properties (Add request-data-sizes-max-wait-sec to session properties prestodb/presto#24918) (HeidiHan0000)
• 3a6ae85 Fix formatting in /security/ docs (Steve Burnett)
• 8068e36 Timeout reading delta tables after incremental updates with null values (Timeout reading delta tables after incremental updates with null values prestodb/presto#24920) (Miguel Blanco Godón)
• 560e065 Fix release note action with unescaped chars (Zac Blanco)
• c6a7a46 Add integer type to visitGenericLiteral in translator (mohsaka)
• 913115c [native] Make constant arg check optional in parseIndexLookupCondition (Zac Wen)
• 38f9ae6 [native] Allow empty file in table scan (Jimmy Lu)
• 6ba1e14 [native] Move parseIndexLookupCondition out so it can be reused (Zac Wen)
• b7fc613 Use feature toggle for logging (Shang Ma)
• af1881b Update error classification for group by with lambdas (Xiao Du)
• 27e37d6 Add additional column metadata to event listener QueryOutputMetadata (Nidhin Varghese)
• 567d4dc Add cosine_similarity function for two arrays (Amit Dutta)
• 0d3a2ed Update zookeeper version to fix CVE-2023-44981 (Shijin)
• 1a3a4f7 [native] Separate Task start logic into a method. (Sergey Pershin)
• b7ef89c Update decimal functions document (mecit-san)
• 816f3db [router] scheduler bug fixes and test enhancements (Router scheduler fixes and unit test case enhancements prestodb/presto#24580) (Jayaprakash Sivaprasad)
• 56d860e refactor: Move MemoryManagerOptions inside MemoryManager step0, explicitly specify object type (refactor: Move MemoryManagerOptions inside MemoryManager step0, explicitly specify object type prestodb/presto#25050) (Ke Wang)
• 7368dd8 [native] Export proper Task create time (Sergey Pershin)
• e5e09c4 Skip presto-main-base tests from test-other-modules (Anant Aneja)
• 0b7398d Upgrade okio-jvm version & add presto-base-arrow-flight version in dependency management (Hazmi)
• 87059e5 Extract WindowNode.Specification as a separate class (mohsaka)
• 8193075 [native] Add presto_protocol_arrow_flight.json to gitignore config (aditi-pandit)
• 47797ed [native]Update task cursor usage and advance velox version (Xiaoxuan Meng)
• 60f1ba7 Add view text hash info to accessControlReferences (Add view text hash info to accessControlReferences prestodb/presto#24955) (Kevin Tang)
• a9a9bae [router] Use nanos for cluster health check (Fix bug in presto-router prestodb/presto#25043) (Anant Aneja)
• 4146f56 Improve empty TableScanNode warning in BaseSubfieldExtractionRewriter (Clear warning for BaseSubfieldExtractionRewriter prestodb/presto#24667) (jkhaliqi)
• 0e0572e Update presto-docs/src/main/sphinx/presto_cpp/properties-session.rst (tanjialiang)
• 318f495 Update presto-docs/src/main/sphinx/presto_cpp/properties-session.rst (tanjialiang)
• a118825 Update presto-docs/src/main/sphinx/presto_cpp/properties-session.rst (tanjialiang)
• d8d1d61 Switch to integer based streaming aggregation output batch session (Jialiang Tan)
• a0562c8 Support reset all readers in startStripe() (Chen Yang)
• e936ad0 [native] Clean up code in PrestoToVeloxQueryPlan (Zac Wen)
• 9f689e9 Add runtime metrics for task time on event loop and log slow execution (Add runtime metrics for task time on event loop and log slow execution prestodb/presto#25009) (Shang Ma)
• f7af3b5 Separate native IndexJoinRewriter from Java path (Zac Wen)
• 4caf30f Add operator < to ArrowColumnHandle protocol (Bryan Cutler)
• 9547eae [native] Map Presto SOURCE_OUTER index join type to Velox LEFT (Zac Wen)
• 8fd33ae [native] Fix native-tests filepath (Pramod Satya)
• dde5c16 Fix: Re-initialize sort key serializer for every new input added (Emily (Xuetong) Sun)
• b0b9c8f Print IndexSourceNode table handle in query plan (Zac Wen)
• 60bbd2e Add support for optional kafka SASL (Shahim Sharafudeen)
• e540ed9 Fix distributed sort parallelism for single node execution (Andrii Rosa)
• b563c8a [native] Track CPU & Memory overload in native worker. (Sergey Pershin)
• 6a89784 Add presto-base-arrow-flight version to root pom (Add presto-base-arrow-flight version to root pom prestodb/presto#25006) (inf)
• 7424bf5 [native] Support in filter for index join (Zac Wen)
• a6ecdb5 Add test coverage for SqlFunctionProperties equals (Add test coverage for SqlFunctionProperties equals prestodb/presto#25002) (XiaoDu)
• acb0321 Use S3 listObjectsV2 in PrestoS3FileSystem listPrefix ([Hive] Use S3 listObjectsV2 in PrestoS3FileSystem listPrefix prestodb/presto#24794) (Deepak Mehra)
• db70178 Upgrade plexus-utils and commons-beanutils (Upgrade plexus-utils and commons-beanutils prestodb/presto#24665) (Mariam AlMesfer)
• 54ff0a1 Fix ARRAYS_OVERLAP function bug (Hazmi)
• 842a3eb Fix compilation of NativeExecutionTypeRewrite (Zac Blanco)
• c2c3598 [native] Advance velox. (Amit Dutta)
• 931d4a6 Check Query integrity in Analyzer Util (Check Query integrity in Analyzer Util prestodb/presto#24927) (Kevin Tang)
• 6a71d6e Add NativeExecutionTypeRewrite (Zac Wen)
• 05b1df9 Allow connector optimizer to apply to IndexSourceNode (Zac Wen)
• 10c586d Improve failure message for QualifiedObjectName not 3 parts (Rebecca Schlussel)
• 1abad21 Improve addColumnMasks efficiency (Bryan Cutler)
• 8f789ec Fetch column masks in bulk (Bryan Cutler)
• 92c7602 Allow returning multiple filters and masks (Bryan Cutler)
• 05906fb Disallow multiple masks on a given column (Bryan Cutler)
• a41eadc Add support for column masking (Bryan Cutler)
• b03ee2c Add support for row filtering (Bryan Cutler)
• ebf7bb8 [Iceberg]Prefer AppendFiles over RowDelta in insert-only statement (wangd)
• 26e1b66 [native] Add index join node protocol unit test (Zac Wen)
• 8c9436f [native] Support between filter for index join (Zac Wen)
• 93a4521 Add system configs to query configs mapping for requestDataSizesMaxWaitSec (Add system configs to query configs mapping for requestDataSizesMaxWaitSec prestodb/presto#24977) (Heidi Han)
• 1143ce4 [sidecar] Fix sidecar-coordinator HTTPS communication and handle IPv6 in URL generation (Pratik Joseph Dabre)
• e5998e8 Add less lock hungry AsyncQueue#offerAll (James Petty)
• 86d05e7 Restore exception handling for IllegalArgumentException during type resolution (Pratik Joseph Dabre)
• 7a97ef8 Use VectorFuzzer for BinarySortableSerializer test (Use VectorFuzzer for BinarySortableSerializer test prestodb/presto#24954) (Emily (Xuetong) Sun)
• ee6bc00 Revise formatting in iceberg.rst (Steve Burnett)
• 2d7abbc [native] Fix blank HTTP host header in requests (Zac Blanco)
• da477e2 Add coordinator health checks and counter jmx metrics to presto router (Auden Woolfson)
• a6f000d fix: TDigest Functions Null Input Behavior (fix: TDigest Functions Null Input Behavior prestodb/presto#24969) (Natasha Sehgal)
• 32d3952 [native] Pin gperf to 3.1 (Deepak Majeti)
• ed70be3 Add filter to IndexJoinNode protocol (Zac Wen)
• dd4e5ef Fix native functional test (Joe Abraham)
• 902c079 Add filter to IndexJoinNode (Zac Wen)
• 33ddf2f Support sorted shuffle write in Sapphire-Velox stack (Emily (Xuetong) Sun)
• 636a75d Add configuration to specify metastore catalog name (Anurag Dwivedi)
• 2f29ba9 Add a BinarySortableSerializer to Sapphire-Velox (Support sorted shuffle write in Sapphire-Velox stack prestodb/presto#24739) (Emily (Xuetong) Sun)
• 34ef2c7 Fix rollback after statement fail in non-autocommit transaction (wangd)
• 0510d1d use "when" (ebonnal)
• 7d2d1a0 Clarify in the documentation that ELEMENT_AT returns NULL when out of bounds (ebonnal)
• 240557b [native] Add session property for eager streaming aggregation flush (Jialiang Tan)
• 4e14711 Fix presto-native-tests CI (Pramod Satya)
• 845275c Refactor MultiJoinNode into a separate class (Haritha Koloth)
• 6e6c787 Add planner rule GroupInnerJoinsByConnectorRuleSet (Haritha Koloth)
• 1cdd77d SPI Changes for Join pushdown (Haritha Koloth)
• 29a4875 Add release note check action (Add release note check action prestodb/presto#24855) (Zac Blanco)
• 906ebcd Refactor out the duplicate definition of method isEntireColumn (wangd)
• b2919fa [native] Save 1 memcpy in parsing message body ([native] Save 1 memcpy in parsing message body prestodb/presto#24941) (Yuanda (Yenda) Li)
• e76f5a5 [native] Advance velox. (Amit Dutta)
• 40e1201 [native] Make PeriodicMemoryChecker member of PrestoServer (Sergey Pershin)
• fb6d9af [native] Minor refactor in http filter registration. (Amit Dutta)
• 36198ee Fix failing CI: pin JVM 8 to 8.0.442 (Zac Blanco)
• 4f8429c Update presto-docs/src/main/sphinx/presto_cpp/features.rst (Xin Zhang)
• 7fb6a6e Update presto-docs/src/main/sphinx/presto_cpp/features.rst (Xin Zhang)
• 8134972 [native] Add S3 metrics reporting (Xin Zhang)
• 2faef71 Upgrade sqlserver driver to version 12.8.1 (lukmanulhakkeem)
• 729508f Fix TDigest::scale() to update sum member. (Sergey Pershin)
• a33f73d Re-introduce improving the merging of operator stats (Re-introduce improving the merging of operator stats prestodb/presto#24921) (Shang Ma)
• 8bcc971 Add factorial implementation, documentation and tests (Samuel Majoros)
• ffd5824 [native] Advance velox. (Amit Dutta)
• c8874d6 [presto] Add state filter to the queryState resource ([presto] Add state filter to the queryState resource prestodb/presto#24856) (Prashant Golash)
• afdd1c7 Add shared-arbitrator.memory-pool-abort-capacity-limit into property registry (Add shared-arbitrator.memory-pool-abort-capacity-limit into property registry prestodb/presto#24915) (Jialiang Tan)
• 3fdeab4 Update deployment.rst (Akinori Musha)
• 36664c3 Add jaro-winkler implementation, documentation and tests (Samuel Majoros)
• 411def9 Make EquiJoinClause fields in IndexJoinNode compatible with protocol (Zac Wen)
• a650ab6 Arrow Flight tests use open port for server (Bryan Cutler)
• beec0e4 Fix confusing OrcCorruptionException thrown by ORC metadata reader (Fix confusing OrcCorruptionException thrown by ORC metadata reader prestodb/presto#24897) (Serge Druzkin)
• 7820553 [native] Fix macos CMake failure (Deepak Majeti)
• ba44ea5 Remove redundant table layout call (Pradeep Vaka)
• 4bdd0a3 [native] Add ConnectorIndexHandle to ConnectorProtocolTemplate (Zac Wen)
• d9d45cb [native] Add protocol generation and incremental build in debug CI build (Christian Zentgraf)
• 432c9aa Upgrade elasticsearch dependency to 7.17.27 (Hazmi)
• ddba4ba Remove DeleteScanInfo (Remove DeleteScanInfo prestodb/presto#24857) (Shelton Cai)
• a972bba Add distinct semi join plan optimization (Jialiang Tan)
• 6ff6375 [native] Add longVariableConstraints to function metadata (Pratik Joseph Dabre)
• 5c63796 Fix sensitive data disclosure in logs (Nivin C S)
• 899f740 Add github action to publish artifacts for presto stable release (Add github action to publish artifacts for presto stable release prestodb/presto#24821) (Li Zhou)
• aac1155 Add longest common prefix implementation, documentation and tests (Samuel Majoros)
• 341129e [native] Add sidecar and sidecar plugin documentation (Pramod Satya)
• 7eb3915 [native] Add protocol for index lookup join plan (Zac Wen)
• 549101d [native] Advance Velox (Zac Wen)
• d756ade use com.facebook.airlift:security in presto-hive-metastore (Zac Blanco)
• 3b9e0f1 Add support for S3 WebIdentity authentication (Sayari Mukherjee)
• fb09580 doc on hive csv limitations (Najib Adan)
• 2d49f44 Add memory pool debug regex (Jialiang Tan)
• 7196add Add documentation for Iceberg support in PrestoCPP (Reetika Agrawal)
• 14a69e9 Reuse JoinType in IndexJoinNode (Zac Wen)
• 02a65c0 Reintroduced json_extract to generate canonicalized output (Reintroduced json_extract to generate canonicalized output prestodb/presto#24879) (XiaoDu)
• 455f847 [native] Add tests for UUID type (aditi-pandit)
• 832aefb Changes to enable ssl/tls in hms (Shijin K)
• ab03978 [native] test modification. (Amit Dutta)
• 3a4ff90 Fix error when describing a nonexistent table (Elbin Pallimalil)
• 31d3e2e [native] Advance velox. (Amit Dutta)
• 574f832 [native] Add a test group for async data cache e2e tests. (Amit Dutta)
• c875296 Add various compressionCodec in PagesSerdeFactory (Xin Zhang)
• 682bf7e Refactor compressionEnabled to compressionCodec in PagesSerdeFactory (Xin Zhang)
• 162d632 Pass full session to avoid Unknown connector errors (Denodo Research Labs)
• c8566b4 revert json_extract to Produce Canonicalized Output (revert json_extract to Produce Canonicalized Output prestodb/presto#24864) (XiaoDu)
• 940a92a Add team-velox as code owners for presto-native-sidecar-plugin and presto-native-tests modules (aditi-pandit)
• 80e765c [native] Fix presto protocol generation for presto-main-base module changes (Zac Blanco)
• 040d925 [native] Fix v1/operation/task/getDetail (Deepak Majeti)
• fb4e489 [native] Advance Velox (aditi-pandit)
• 45e0e21 [native] Remove register-test-functions worker config (Pramod Satya)
• d16d9d7 Add Iceberg ManifestFile cache invalidation procedure (Reetika Agrawal)
• f6962c7 Add Iceberg StatisticsFile cache invalidation procedure (Reetika Agrawal)
• b0286c5 Upgrade the MySQL to version 9.2.0 (namya28)
• 168caf0 [native] Remove presto_types and presto_connectors cyclic dependency (Deepak Majeti)
• c9ee8a7 [native] Include a header for forward declaration (Zac Wen)
• c6bbe07 Include errors for presto-ui dependency install (Deepak Majeti)
• 43a1662 Support bucket transform for columns of type TimeType in Iceberg table (wangd)
• 9abb67b OperatorStats overflow fix (Natasha Sehgal)
• f7d99dc Add test scope back to presto-tpch in presto-main (Zac Blanco)
• 03e535c Remove duplicated code in ValuesMatcher.java (Xin Zhang)
• f87e321 [native] Advance velox. (Amit Dutta)
• 79742a9 Remove negative check on 'outputDataSizeInBytes' stat. (Sergey Pershin)
• 6e17a03 Add Jmx metrics information for caching in Iceberg (Reetika Agrawal)
• cd4a9a0 [presto][ui] Display queued queries per subgroup RG ([presto][ui] Display queued queries per subgroup RG prestodb/presto#24830) (Prashant Golash)
• f9faf6a Fix: RedisProviderPlugin cannot be instantiated using reflection in PluginManager (Heng Xiao)
• 20ea3cc squash this into one commit if needed (Jacob Khaliqi)
• 61104af Updated deprecated hadoop properties (Jacob Khaliqi)
• d22d3c2 Add DeleteNode translation to TableWriteNode in Velox query plan ([native] Add DeleteNode translation to TableWriteNode in Velox query plan prestodb/presto#24772) (Gary Helmling)
• f8b8484 [native] Advance velox. (Amit Dutta)
• e518802 Run presto-native-tests with DWRF and PARQUET (Pramod Satya)
• 4dc8260 Add Presto C++ topic to connector/base-arrow-flight.rst (Steve Burnett)