-Azure Data Factory pipelines use the COPY INTO statement to ingest data at scale into dedicated SQL Pool tables. In some rare cases, the COPY INTO statement can fail when loading CSV files into dedicated SQL Pool table when file split is used in an Azure Data Factory pipeline. File splitting is a mechanism that improves load performance when a small number of larger (1GB+) files are loaded in a single copy task. When file splitting is enabled, a single file can be loaded by multiple parallel threads, where every thread is assigned a part of the file.
0 commit comments