You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/open-datasets/overview-what-are-open-datasets.md
+16-14Lines changed: 16 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,30 +5,31 @@ ms.service: open-datasets
5
5
ms.topic: overview
6
6
author: fbsolo-ms1
7
7
ms.author: franksolomon
8
-
ms.date: 05/06/2020
8
+
ms.date: 07/29/2024
9
9
---
10
10
11
11
# What are Azure Open Datasets and how can you use them?
12
12
13
-
[Azure Open Datasets](https://azure.microsoft.com/services/open-datasets/) are curated public datasets that you can use to add scenario-specific features to machine learning solutions for more accurate models. Open Datasets are in the cloud on Microsoft Azure and are integrated into Azure Machine Learning and readily available to Azure Databricks and Machine Learning Studio (classic). You can also access the datasets through APIs and use them in other products, such as Power BI and Azure Data Factory.
13
+
[Azure Open Datasets](https://azure.microsoft.com/services/open-datasets/) are curated public datasets that you can add to scenario-specific features to machine learning solutions, for more accurate models. Open Datasets are available in the cloud, on Microsoft Azure. They're integrated into Azure Machine Learning and readily available to Azure Databricks and Machine Learning Studio (classic). You can also access the datasets through APIs and you can use them in other products, such as Power BI and Azure Data Factory.
14
14
15
-
Datasets include public-domain data for weather, census, holidays, public safety, and location that help you train machine learning models and enrich predictive solutions. You can also share your public datasets on Azure Open Datasets.
15
+
Datasets include public-domain data for weather, census, holidays, public safety, and location that help you train machine learning models and enrich predictive solutions. You can also share your public datasets through Azure Open Datasets.
16
16
17
-

17
+
:::image type="content" source="./media/overview-what-are-open-datasets/open-datasets-components.png" lightbox="./media/overview-what-are-open-datasets/open-datasets-components.png" alt-text="Diagram that shows the Azure Open Datasets service Building blocks.":::
18
18
19
19
## Curated, prepared datasets
20
-
Curated open public datasets in Azure Open Datasets are optimized for consumption in machine learning workflows.
21
20
22
-
To see all the datasets available, go to the [Azure Open Datasets Catalog](https://azure.microsoft.com/services/open-datasets/catalog/).
21
+
Curated open public datasets in Azure Open Datasets are optimized for consumption in machine learning workflows.
23
22
24
-
Data scientists often spend the majority of their time cleaning and preparing data for advanced analytics. Open Datasets are copied to the Azure cloud and preprocessed to save you time. At regular intervals data is pulled from the sources, such as by an FTP connection to the National Oceanic and Atmospheric Administration (NOAA). Next, data is parsed into a structured format, and then enriched as appropriate with features such as ZIP Code or location of the nearest weather station.
23
+
For more information about the available datasets, visit the [Azure Open Datasets Catalog](https://azure.microsoft.com/services/open-datasets/catalog/) resource.
25
24
26
-
Datasets are cohosted with cloud compute in Azure making access and manipulation easier.
25
+
Data scientists often spend the majority of their time cleaning and preparing data for advanced analytics. To save you time, open Datasets are copied to the Azure cloud, and then preprocessed. At regular intervals, data is pulled from the sources - for example, by an FTP connection to the National Oceanic and Atmospheric Administration (NOAA). Next, the data is parsed into a structured format, and then enriched as needed, with features such as ZIP Code or the locations of the nearest weather stations.
27
26
28
-
Following are examples of datasets available.
27
+
Datasets are cohosted with cloud compute in Azure, to make access and manipulation easier.
|[NOAA Integrated Surface Data (ISD)](https://azure.microsoft.com/services/open-datasets/catalog/noaa-integrated-surface-data/)|[Azure Notebooks](https://azure.microsoft.com/services/open-datasets/catalog/noaa-integrated-surface-data/?tab=data-access#AzureNotebooks) <br> [Azure Databricks](https://azure.microsoft.com/services/open-datasets/catalog/noaa-integrated-surface-data/?tab=data-access#AzureDatabricks)| Worldwide hourly weather data from NOAA with the best spatial coverage in North America, Europe, Australia, and parts of Asia. Updated daily. |
@@ -38,12 +39,13 @@ Following are examples of datasets available.
|[Public Holidays](https://azure.microsoft.com/services/open-datasets/catalog/public-holidays/)|[Azure Notebooks](https://azure.microsoft.com/services/open-datasets/catalog/public-holidays/?tab=data-access#AzureNotebooks) <br> [Azure Databricks](https://azure.microsoft.com/services/open-datasets/catalog/public-holidays/?tab=data-access#AzureDatabricks)| Worldwide public holiday data, covering 41 countries or regions from 1970 to 2099. Includes country/region and whether most people have paid time off. |
42
+
|[Public Holidays](https://azure.microsoft.com/services/open-datasets/catalog/public-holidays/)|[Azure Notebooks](https://azure.microsoft.com/services/open-datasets/catalog/public-holidays/?tab=data-access#AzureNotebooks) <br> [Azure Databricks](https://azure.microsoft.com/services/open-datasets/catalog/public-holidays/?tab=data-access#AzureDatabricks)| Worldwide public holiday data, covering 41 nations or regions from 1970 to 2099. Includes country/region and whether most people have paid time off. |
43
+
44
+
## Access to datasets
42
45
43
-
## Access to datasets
44
-
With an Azure account, you can access open datasets using code or through the Azure service interface. The data is colocated with Azure cloud compute resources for use in your machine learning solution.
46
+
With an Azure account, you can access open datasets through code or through the Azure service interface. The data is colocated with Azure cloud compute resources for use in your machine learning solutions.
45
47
46
-
Open Datasets are available through the Azure Machine Learning UI and SDK. Open Datasets also provides Azure Notebooks and Azure Databricks notebooks you can use to connect data to Azure Machine Learning and Azure Databricks. Datasets can also be accessed through a Python SDK.
48
+
Open Datasets are available through the Azure Machine Learning UI and SDK. Open Datasets also provide Azure Notebooks and Azure Databricks notebooks that can connect data to Azure Machine Learning and Azure Databricks. Datasets can also be accessed through a Python SDK.
47
49
48
50
However, you don't need an Azure account to access Open Datasets; you can access them from any Python environment with or without Spark.
0 commit comments