Skip to content

Commit 31c1f3d

Browse files
Merge pull request #211535 from kromerm/dfupdates
Update data-flow-source.md
2 parents 1a11e4a + f110fcf commit 31c1f3d

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

articles/data-factory/data-flow-source.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,15 @@ Inline datasets are recommended when you use flexible schemas, one-off source in
3333

3434
To use an inline dataset, select the format you want in the **Source type** selector. Instead of selecting a source dataset, you select the linked service you want to connect to.
3535

36+
### Schema options
37+
38+
Because an inline dataset is defined inside the data flow, there is not a defined schema associated with the inline dataset. On the Projection tab, you can import the source data schema and store that schema as your source projection. On this tab, you will find a "Schema options" button that allows you to define the behavior of ADF's schema discovery service.
39+
40+
* Use projected schema: This option is useful when you have a large number of source files that ADF will scan as your source. ADF's default behavior is to discover the schema of every source file. But if you have a pre-defined projection already stored in your source transformation, you can set this to true and ADF will skip auto-discovery of every schema. With this option turned on, the source transformation can read all files in a much faster manner, applying the pre-defined schema to every file.
41+
* Allow schema drift: Turn on schema drift so that your data flow will allow new columns that are not already defined in the source schema.
42+
* Validate schema: Setting this option will cause data flow to fail if any column and type defined in the projection does not match the discovered schema of the source data.
43+
* Infer drifted column types: When new drifted columns are identified by ADF, those new columns will be cast to the appropriate data type using ADF's automatic type inference.
44+
3645
:::image type="content" source="media/data-flow/inline-selector.png" alt-text="Screenshot that shows Inline selected.":::
3746

3847
## Workspace DB (Synapse workspaces only)

0 commit comments

Comments
 (0)