You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/solution-template-copy-new-files-last-modified-date.md
+22-14Lines changed: 22 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -32,23 +32,31 @@ The template defines six parameters:
32
32
33
33
## How to use this solution template
34
34
35
-
1. Go to template **Copy new files only by LastModifiedDate**. Create a **New** connection to your destination store. The destination store is where you want to copy files to.
35
+
1. Navigate to the **Template Gallery** from the **Author** tab in Azure Data Factory, then choose the **+** button, **Pipeline**, and finally **Template Gallery**.
36
+
37
+
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/open-template-gallery.png" alt-text="Screenshot showing how to open the Template gallery from the Azure Data Factory Studio's Author tab.":::
38
+
39
+
1. Search for the template **Copy new files only by LastModifiedDate**, select it, and then select **Continue**.
40
+
41
+
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/select-last-modified-date-template.png" alt-text="Screenshot showing how to find and select the Copy new files only by LastModifiedDate template.":::
42
+
43
+
1. Create a **New** connection to your destination store. The destination store is where you want to copy files to.
36
44
37
45
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-1.png" alt-text="Create a new connection to the source":::
38
46
39
-
2. Create a **New** connection to your source storage store. The source storage store is where you want to copy files from.
47
+
1. Create a **New** connection to your source storage store. The source storage store is where you want to copy files from.
40
48
41
49
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-3.png" alt-text="Create a new connection to the destination":::
42
50
43
-
3. Select **Use this template**.
51
+
1. Select **Use this template**.
44
52
45
53
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-4.png" alt-text="Use this template":::
46
54
47
-
4. You will see the pipeline available in the panel, as shown in the following example:
55
+
1. You will see the pipeline available in the panel, as shown in the following example:
48
56
49
57
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-5.png" alt-text="Show the pipeline":::
50
58
51
-
5. Select **Debug**, write the value for the **Parameters** and select **Finish**. In the picture below, we set the parameters as following.
59
+
1. Select **Debug**, write the value for the **Parameters** and select **Finish**. In the picture below, we set the parameters as following.
52
60
-**FolderPath_Source** = sourcefolder
53
61
-**Directory_Source** = subfolder
54
62
-**FolderPath_Destination** = destinationfolder
@@ -60,21 +68,21 @@ The template defines six parameters:
60
68
61
69
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-6.png" alt-text="Run the pipeline":::
62
70
63
-
6. Review the result. You will see only the files last modified within the configured timespan has been copied to the destination store.
71
+
1. Review the result. You will see only the files last modified within the configured timespan has been copied to the destination store.
64
72
65
73
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-7.png" alt-text="Review the result":::
66
74
67
-
7. Now you can add a tumbling windows trigger to automate this pipeline, so that the pipeline can always copy new and changed files only by LastModifiedDate periodically. Select **Add trigger**, and select **New/Edit**.
75
+
1. Now you can add a tumbling windows trigger to automate this pipeline, so that the pipeline can always copy new and changed files only by LastModifiedDate periodically. Select **Add trigger**, and select **New/Edit**.
68
76
69
77
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-8.png" alt-text="Screenshot that highlights the New/Edit menu option that appears when you select Add trigger.":::
70
78
71
-
8. In the **Add Triggers** window, select **+ New**.
79
+
1. In the **Add Triggers** window, select **+ New**.
72
80
73
-
9. Select **Tumbling Window** for the trigger type, set **Every 15 minute(s)** as the recurrence (you can change to any interval time). Select **Yes** for Activated box, and then select **OK**.
81
+
1. Select **Tumbling Window** for the trigger type, set **Every 15 minute(s)** as the recurrence (you can change to any interval time). Select **Yes** for Activated box, and then select **OK**.
12. Create new files in your source folder of data source store. You are now waiting for the pipeline to be triggered automatically and only the new files will be copied to the destination store.
99
+
1. Create new files in your source folder of data source store. You are now waiting for the pipeline to be triggered automatically and only the new files will be copied to the destination store.
92
100
93
-
13. Select **Monitor** tab in the left navigation panel, and wait for about 15 minutes if the recurrence of trigger has been set to every 15 minutes.
101
+
1. Select **Monitor** tab in the left navigation panel, and wait for about 15 minutes if the recurrence of trigger has been set to every 15 minutes.
94
102
95
-
14. Review the result. You will see your pipeline will be triggered automatically every 15 minutes, and only the new or changed files from source store will be copied to the destination store in each pipeline run.
103
+
1. Review the result. You will see your pipeline will be triggered automatically every 15 minutes, and only the new or changed files from source store will be copied to the destination store in each pipeline run.
96
104
97
105
:::image type="content" source="media/solution-template-copy-new-files-last-modified-date/copy-new-files-last-modified-date-15.png" alt-text="Screenshot that shows the results that return when the pipeline is triggered.":::
0 commit comments