Skip to content

Commit c65ebb8

Browse files
Merge pull request #232946 from jovanpop-msft/patch-240
Delta reader v2 and column mapping are not supported
2 parents 8d93881 + 83174d6 commit c65ebb8

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

articles/synapse-analytics/sql/resources-self-help-sql-on-demand.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -865,6 +865,7 @@ There are some limitations that you might see in Delta Lake support in serverles
865865
- Serverless SQL pools don't support time travel queries. Use Apache Spark pools in Synapse Analytics to [read historical data](../spark/apache-spark-delta-lake-overview.md?pivots=programming-language-python#read-older-versions-of-data-using-time-travel).
866866
- Serverless SQL pools don't support updating Delta Lake files. You can use serverless SQL pool to query the latest version of Delta Lake. Use Apache Spark pools in Synapse Analytics to [update Delta Lake](../spark/apache-spark-delta-lake-overview.md?pivots=programming-language-python#update-table-data).
867867
- You can't [store query results to storage in Delta Lake format](create-external-table-as-select.md) by using the CETAS command. The CETAS command supports only Parquet and CSV as the output formats.
868+
- Serverless SQL pools in Synapse Analytics are compatible with Delta reader version 1. The Delta features that require Delta readers with version 2 or higher (for example [column mapping](https://github.com/delta-io/delta/blob/master/PROTOCOL.md#reader-requirements-for-column-mapping)) are not supported in the serverless SQL pools.
868869
- Serverless SQL pools in Synapse Analytics don't support the datasets with the [BLOOM filter](/azure/databricks/optimizations/bloom-filters). The serverless SQL pool ignores the BLOOM filters.
869870
- Delta Lake support isn't available in dedicated SQL pools. Make sure that you use serverless SQL pools to query Delta Lake files.
870871
- For more information about known issues with serverless SQL pools, see [Azure Synapse Analytics known issues](../known-issues.md).
@@ -873,6 +874,10 @@ There are some limitations that you might see in Delta Lake support in serverles
873874

874875
The serverless SQL pool does not support querying Delta Lake tables with the [renamed columns](https://docs.delta.io/latest/delta-batch.html#rename-columns). Serverless SQL pool cannot read data from the renamed column.
875876

877+
### The value of a column in the Delta table is NULL
878+
879+
If you are using Delta data set that requires a Delta reader version 2 or higher, and uses the features that are unsupported in version 1 (for example - renaming columns, dropping columns, or column mapping), the values in the referenced columns might not be shown.
880+
876881
### JSON text isn't properly formatted
877882

878883
This error indicates that serverless SQL pool can't read the Delta Lake transaction log. You'll probably see the following error:

0 commit comments

Comments
 (0)