Skip to content

Commit 03d963a

Browse files
authored
Merge pull request #211675 from Clare-Zheng82/0919-Update_dataflow_concept_Schema_drift
[Doc update] - Update concepts data flow schema drift outdated screenshots
2 parents 2a13a74 + 18721e0 commit 03d963a

File tree

8 files changed

+4
-4
lines changed

8 files changed

+4
-4
lines changed

articles/data-factory/concepts-data-flow-schema-drift.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ ms.service: data-factory
99
ms.subservice: data-flows
1010
ms.topic: conceptual
1111
ms.custom: synapse
12-
ms.date: 09/09/2021
12+
ms.date: 09/19/2022
1313
---
1414

1515
# Schema drift in mapping data flow
@@ -38,15 +38,15 @@ Columns coming into your data flow from your source definition are defined as "d
3838

3939
In a source transformation, schema drift is defined as reading columns that aren't defined in your dataset schema. To enable schema drift, check **Allow schema drift** in your source transformation.
4040

41-
:::image type="content" source="media/data-flow/schemadrift001.png" alt-text="Schema drift source":::
41+
:::image type="content" source="media/data-flow/schema-drift-1.png" alt-text="Schema drift source":::
4242

4343
When schema drift is enabled, all incoming fields are read from your source during execution and passed through the entire flow to the Sink. By default, all newly detected columns, known as *drifted columns*, arrive as a string data type. If you wish for your data flow to automatically infer data types of drifted columns, check **Infer drifted column types** in your source settings.
4444

4545
## Schema drift in sink
4646

4747
In a sink transformation, schema drift is when you write additional columns on top of what is defined in the sink data schema. To enable schema drift, check **Allow schema drift** in your sink transformation.
4848

49-
:::image type="content" source="media/data-flow/schemadrift002.png" alt-text="Schema drift sink":::
49+
:::image type="content" source="media/data-flow/schema-drift-2.png" alt-text="Schema drift sink":::
5050

5151
If schema drift is enabled, make sure the **Auto-mapping** slider in the Mapping tab is turned on. With this slider on, all incoming columns are written to your destination. Otherwise you must use rule-based mapping to write drifted columns.
5252

@@ -70,7 +70,7 @@ To explicitly reference drifted columns, you can quickly generate mappings for t
7070

7171
In the generated Derived Column transformation, each drifted column is mapped to its detected name and data type. In the above data preview, the column 'movieId' is detected as an integer. After **Map Drifted** is clicked, movieId is defined in the Derived Column as `toInteger(byName('movieId'))` and included in schema views in downstream transformations.
7272

73-
:::image type="content" source="media/data-flow/mapdrifted2.png" alt-text="Screenshot shows the Derived Column's Settings tab.":::
73+
:::image type="content" source="media/data-flow/map-drifted-2.png" alt-text="Screenshot shows the Derived Column's Settings tab.":::
7474

7575
## Next steps
7676
In the [Data Flow Expression Language](data-transformation-functions.md), you'll find additional facilities for column patterns and schema drift including "byName" and "byPosition".
-42.3 KB
Loading
52.1 KB
Loading
Binary file not shown.
28.7 KB
Loading
25.1 KB
Loading
Binary file not shown.
Binary file not shown.

0 commit comments

Comments
 (0)