|
| 1 | +--- |
| 2 | +title: Monitor Azure Data Factory and Azure Synapse Analytics pipelines with annotations and user properties |
| 3 | +description: Advanced monitoring with annotations and user properties |
| 4 | +author: olmoloce |
| 5 | +ms.author: olmoloce |
| 6 | +ms.reviewer: olmoloce |
| 7 | +ms.service: data-factory |
| 8 | +ms.subservice: monitoring |
| 9 | +ms.topic: conceptual |
| 10 | +ms.date: 11/01/2022 |
| 11 | +--- |
| 12 | + |
| 13 | +# Monitor Azure Data Factory and Azure Synapse Analytics pipelines with annotations and user properties |
| 14 | + |
| 15 | +[!INCLUDE[appliesto-adf-asa-md](includes/appliesto-adf-asa-md.md)] |
| 16 | + |
| 17 | +When monitoring your data pipelines, you may want to be able to filter and monitor a certain group of activities, such as those of a project or specific department's pipelines. You may also need to further monitor activities based on dynamic properties. You can achieve these things by leveraging annotations and user properties. |
| 18 | + |
| 19 | +## Annotations |
| 20 | + |
| 21 | +Azure Data Factory annotations are tags that you can add to your Azure Data Factory or Azure Synapse Analytics entities to easily identify them. An annotation allows you to classify or group different entities in order to easily monitor or filter them after an execution. Annotations only allow you to define static values and can be added to pipelines, datasets, linked services and triggers. |
| 22 | + |
| 23 | +## User properties |
| 24 | + |
| 25 | +User properties are key-value pairs defined at the activity level. By adding user properties, you can view additional information about activities under activity runs window that may help you to monitor your activity executions. |
| 26 | +User properties allow you to define dynamic values and can be added to any activity, up to 5 per activity, under User Properties tab. |
| 27 | + |
| 28 | +## Create and use annotations and user properties |
| 29 | + |
| 30 | +As we discussed, annotations are static values that you can assign to pipelines, datasets, linked services, and triggers. Let's assume you want to filter for pipelines that belong to the same business unit or project name. We will first create the annotation. Click on the Properties icon, + New button and name your annotation appropriately. We advise being consistent with your naming. |
| 31 | + |
| 32 | + |
| 33 | + |
| 34 | +When you go to the Monitor tab, you can filter under Pipeline runs for this Annotation: |
| 35 | + |
| 36 | + |
| 37 | + |
| 38 | +If you want to monitor for dynamic values at the activity level, you can do so by leveraging the User properties. You can add these under any activity by clicking on the Activity box, User properties tab and the + New button: |
| 39 | + |
| 40 | + |
| 41 | + |
| 42 | +For Copy Activity specifically, you can auto-generate these: |
| 43 | + |
| 44 | + |
| 45 | + |
| 46 | +To monitor User properties, go to the Activity runs monitoring view. Here you will see all the properties you added. |
| 47 | + |
| 48 | + |
| 49 | + |
| 50 | +You can remove some from the view if you click on the Bookmark sign: |
| 51 | + |
| 52 | + |
| 53 | + |
| 54 | +## Next steps |
| 55 | + |
| 56 | +To learn more about monitoring see [Visually monitor Azure Data Factory.](./monitor-visually.md) |
0 commit comments