You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
+[Azure Data Factory](#azure-data-factory) pipelines, specifically built to extract, load, and transform data
22
22
23
-
Data ingestion is the process in which unstructured data is extracted from one or multiple sources and then prepared for training machine learning models. It's also time intensive, especially if done manually, and if you have large amounts of data from multiple sources. Automating this effort frees up resources and ensures your models use the most recent and applicable data.
23
+
+[Azure Machine Learning Python SDK](#azure-machine-learning-python-sdk), providing a custom code solution for basic data ingestion tasks.
24
+
25
+
+ a combination of both
24
26
25
-
Azure Data Factory (ADF) is specifically built to extract, load, and transform data, however the Python SDK let's you develop a custom code solution for basic data ingestion tasks. If neither are quite what you need, you can also use ADF and the Python SDK together to create an overall data ingestion workflow that meets your needs.
27
+
Data ingestion is the process in which unstructured data is extracted from one or multiple sources and then prepared for training machine learning models. It's also time intensive, especially if done manually, and if you have large amounts of data from multiple sources. Automating this effort frees up resources and ensures your models use the most recent and applicable data.
26
28
27
-
## Use Azure Data Factory
29
+
## Azure Data Factory
28
30
29
31
[Azure Data Factory](https://docs.microsoft.com/azure/data-factory/introduction) offers native support for data source monitoring and triggers for data ingestion pipelines.
30
32
@@ -51,7 +53,7 @@ These steps and the following diagram illustrate Azure Data Factory's data inges
51
53
52
54
Learn how to build a data ingestion pipeline for Machine Learning with [Azure Data Factory](how-to-data-ingest-adf.md).
53
55
54
-
## Use the Python SDK
56
+
## Azure Machine Learning Python SDK
55
57
56
58
With the [Python SDK](https://docs.microsoft.com/python/api/overview/azure/ml), you can incorporate data ingestion tasks into an [Azure Machine Learning pipeline](how-to-create-your-first-pipeline.md) step.
57
59
@@ -69,5 +71,7 @@ In the following diagram, the Azure Machine Learning pipeline consists of two st
69
71
70
72
## Next steps
71
73
72
-
* Learn how to build a data ingestion pipeline for Machine Learning with [Azure Data Factory](how-to-data-ingest-adf.md)
73
-
* Learn how to automate and manage the development life cycles of your data ingestion pipelines with [Azure Pipelines](how-to-cicd-data-ingestion.md).
74
+
Follow these how-to articles:
75
+
*[Build a data ingestion pipeline with Azure Data Factory](how-to-data-ingest-adf.md)
76
+
77
+
*[Automate and manage data ingestion pipelines with Azure Pipelines](how-to-cicd-data-ingestion.md).
0 commit comments