You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When you want to copy huge amounts of objects (for example, thousands of tables) or load data from large variety of sources, the appropriate approach is to input the name list of the objects with required copy behaviors in a control table, and then use parameterized pipelines to read the same from the control table and apply them to the jobs accordingly. By doing so, you can maintain (for example, add/remove) the objects list to be copied easily by just updating the object names in control table instead of redeploying the pipelines. What’s more, you will have single place to easily check which objects copied by which pipelines/triggers with defined copy behaviors.
@@ -32,7 +32,7 @@ Copy data tool in ADF eases the journey of building such metadata driven data co
> If you select tabular data store, you will have chance to further select either full load or incremental load in the next page. If you select storage store, you can further select full load only in the next page. Incrementally loading new files only from storage store is currently not supported.
35
+
> If you select tabular data store, you will have chance to further select either full load or delta load in the next page. If you select storage store, you can further select full load only in the next page. Incrementally loading new files only from storage store is currently not supported.
36
36
37
37
4. Choose **loading behavior**.
38
38
>[!TIP]
@@ -160,7 +160,7 @@ This pipeline will copy one batch of objects. The objects belonging to this batc
160
160
| Parameters name | Description |
161
161
|:--- |:--- |
162
162
| MaxNumberOfObjectsReturnedFromLookupActivity | In order to avoid reaching the limit of output lookup activity, there is a way to define the max number of objects returned by lookup activity. In most case, the default value is not required to be changed. |
163
-
|TopLayerPipelineName| The name of top layer pipeline. |
163
+
|TopLevelPipelineName| The name of top layer pipeline. |
164
164
| TriggerName | The name of trigger. |
165
165
| CurrentSequentialNumberOfBatch | The ID of sequential batch. |
166
166
| SumOfObjectsToCopy | The total number of objects to copy. |
0 commit comments