Skip to content

Commit b6a901f

Browse files
authored
Release v0.11.3 (#2209)
## Analyzer - Optimized SAS Analyzer performance by consolidating regex operations, delivering roughly a 7x speed improvement for large-scale SAS analysis workloads. - Added support for new SSIS components Microsoft.Pivot, Microsoft.UnPivot, and ExtensibleFileTask, broadening coverage for SSIS package migrations analysis. ## Converters – Morpheus - Core - Significantly improved ANTLR parsing performance by merging grammars, refactoring ambiguous rules, and updating the Scala integration and build pipeline for the new grammar workflow. - Allowed the STREAMS token to be used as an identifier so patterns like SELECT * FROM streams.foo.bar now parse correctly in Snowflake-oriented SQL. - Updated the error reporting to align to the following: - - `Info`: no error, the input was fully translated - `Hint`: the input was fully translated but some irrelevant bits have been elided - `Warning`: the input was translated but with unsupported bits - `Error`: the input couldn't be translated - MSSQL / T-SQL / SQL Server - Added full support for SQL Server T-SQL CREATE INDEX and table-level index directives, parsing them into a new index IR and translating to CLUSTER BY AUTO in Databricks SQL so index statements are no longer rejected. - Extended grammar and parsing to handle T-SQL computed columns, QUOTENAME calls, GROUP options in query hints, DROP INDEX statements, and additional keywords like PARAMETERS, STREAMS, PROCEDURES, and VIEWS, improving coverage of real-world T-SQL workloads. - Improved DML parsing so INSERT targets use proper dot identifiers instead of expression-like forms, preventing misinterpretation as function calls and preserving case sensitivity where required. - Re-enabled and migrated T-SQL functional tests to a YAML-based format, expanding automated coverage and keeping still-failing cases isolated for follow-up. ## Converters – BladeBridge - MSSQL / SSIS / T-SQL - Resolved issues with column names containing single quotes and standardized DATEADD and DATEDIFF function patterns to improve compatibility across target SQL dialects. - DataStage - Implemented mapping for the JulianDayFromDate function with corresponding tests, extending DataStage function coverage in the converter. - Enhanced DataStage Spark and workflow handling by adding Databricks cluster sections, improving widget default handling, and mapping TransformStringToDate and spark.sqltemplate attributes for smoother Spark migrations. ## Reconcile - Improved reconciliation hash query generation to guarantee consistent column ordering across SQL dialects, preventing false hash mismatches when column names are substrings of each other. - Reverted the Oracle reconcile implementation to use MD5 via DBMS_CRYPTO.HASH with RAWTOHEX, restoring compatibility with Oracle 11 while keeping the updated QueryBuilder engine handling.. ## Documentation - Added practical details about how to extend BladeBridge configurations Dependency updates: * Bump actions/checkout from 5 to 6 ([#2158](#2158)).
1 parent c2c0bb0 commit b6a901f

2 files changed

Lines changed: 57 additions & 1 deletion

File tree

CHANGELOG.md

Lines changed: 56 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,61 @@
11
# Version changelog
22

3+
## 0.11.3
4+
5+
## Analyzer
6+
7+
- Optimized SAS Analyzer performance by consolidating regex operations, delivering roughly a 7x speed improvement for large-scale SAS analysis workloads.
8+
- Added support for new SSIS components Microsoft.Pivot, Microsoft.UnPivot, and ExtensibleFileTask, broadening coverage for SSIS package migrations analysis.
9+
10+
## Converters – Morpheus
11+
- Core
12+
- Significantly improved ANTLR parsing performance by merging grammars, refactoring ambiguous rules, and updating the Scala integration and build pipeline for the new grammar workflow.
13+
- Allowed the STREAMS token to be used as an identifier so patterns like SELECT * FROM streams.foo.bar now parse correctly in Snowflake-oriented SQL.
14+
- Updated the error reporting to align to the following:
15+
- - `Info`: no error, the input was fully translated
16+
- `Hint`: the input was fully translated but some irrelevant bits have been elided
17+
- `Warning`: the input was translated but with unsupported bits
18+
- `Error`: the input couldn't be translated
19+
20+
- MSSQL / T-SQL / SQL Server
21+
22+
- Added full support for SQL Server T-SQL CREATE INDEX and table-level index directives, parsing them into a new index IR and translating to CLUSTER BY AUTO in Databricks SQL so index statements are no longer rejected.
23+
24+
- Extended grammar and parsing to handle T-SQL computed columns, QUOTENAME calls, GROUP options in query hints, DROP INDEX statements, and additional keywords like PARAMETERS, STREAMS, PROCEDURES, and VIEWS, improving coverage of real-world T-SQL workloads.
25+
26+
- Improved DML parsing so INSERT targets use proper dot identifiers instead of expression-like forms, preventing misinterpretation as function calls and preserving case sensitivity where required.
27+
28+
- Re-enabled and migrated T-SQL functional tests to a YAML-based format, expanding automated coverage and keeping still-failing cases isolated for follow-up.
29+
30+
31+
## Converters – BladeBridge
32+
33+
- MSSQL / SSIS / T-SQL
34+
35+
- Resolved issues with column names containing single quotes and standardized DATEADD and DATEDIFF function patterns to improve compatibility across target SQL dialects.
36+
37+
- DataStage
38+
39+
- Implemented mapping for the JulianDayFromDate function with corresponding tests, extending DataStage function coverage in the converter.
40+
41+
- Enhanced DataStage Spark and workflow handling by adding Databricks cluster sections, improving widget default handling, and mapping TransformStringToDate and spark.sqltemplate attributes for smoother Spark migrations.
42+
43+
44+
## Reconcile
45+
46+
- Improved reconciliation hash query generation to guarantee consistent column ordering across SQL dialects, preventing false hash mismatches when column names are substrings of each other.
47+
48+
- Reverted the Oracle reconcile implementation to use MD5 via DBMS_CRYPTO.HASH with RAWTOHEX, restoring compatibility with Oracle 11 while keeping the updated QueryBuilder engine handling..
49+
50+
## Documentation
51+
52+
- Added practical details about how to extend BladeBridge configurations
53+
54+
55+
Dependency updates:
56+
57+
* Bump actions/checkout from 5 to 6 ([#2158](https://github.com/databrickslabs/lakebridge/pull/2158)).
58+
359
## 0.11.2
460

561
# Analyzer
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
# DO NOT MODIFY THIS FILE
2-
__version__ = "0.11.2"
2+
__version__ = "0.11.3"

0 commit comments

Comments
 (0)