You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/energy-data-services/concepts-csv-parser-ingestion.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,7 +14,7 @@ A CSV (comma-separated values) file is a comma delimited text file that is used
14
14
15
15
A CSV Parser [DAG](https://airflow.apache.org/docs/apache-airflow/1.10.12/concepts.html#dags) allows a customer to load data into Microsoft Azure Data Manager for Energy Preview instance based on a custom schema that is, a schema that doesn't match the [OSDU™](https://osduforum.org) canonical schema. Customers must create and register the custom schema using the Schema service before loading the data.
16
16
17
-
A CSV Parser DAG implements an ELT (Extract Load and Transform) approach to data loading, that is, data is first extracted from the source system in a CSV format, and it's loaded into the Microsoft Energy Data Service Preview instance. It could then be transformed to the [OSDU™](https://osduforum.org) canonical schema using a mapping service.
17
+
A CSV Parser DAG implements an ELT (Extract Load and Transform) approach to data loading, that is, data is first extracted from the source system in a CSV format, and it's loaded into the Azure Data Manager for Energy Preview instance. It could then be transformed to the [OSDU™](https://osduforum.org) canonical schema using a mapping service.
18
18
19
19
[!INCLUDE [preview features callout](./includes/preview/preview-callout.md)]
20
20
@@ -24,11 +24,11 @@ A CSV Parser DAG allows the customers to load the CSV data into the Microsoft Az
24
24
## CSV parser ingestion components
25
25
26
26
The CSV Parser DAG workflow is made up of the following services:
27
-
***File service** facilitates the management of files in the Microsoft Energy Data Services instance. It allows the user to securely upload, discovery and download files from the data platform.
28
-
***Schema service** facilitates the management of schemas in the Microsoft Energy Data Services instance. It allows the user to create, fetch and search for schemas in the data platform.
27
+
***File service** facilitates the management of files in the Azure Data Manager for Energy Preview instance. It allows the user to securely upload, discovery and download files from the data platform.
28
+
***Schema service** facilitates the management of schemas in the Azure Data Manager for Energy Preview instance. It allows the user to create, fetch and search for schemas in the data platform.
29
29
***Storage Service** facilitates the storage of metadata information for domain entities ingested into the data platform. It also raises storage record change events that allow downstream services to perform operations on ingested metadata records.
30
30
***Unit Service** facilitates the management and conversion of units
31
-
***Workflow service** facilitates the management of workflows in the Microsoft Energy Data Services instance. It's a wrapper service on top of the Airflow orchestration engine.
31
+
***Workflow service** facilitates the management of workflows in the Azure Data Manager for Energy Preview instance. It's a wrapper service on top of the Airflow orchestration engine.
Access management is a critical function for any service or resource. Entitlement service helps you manage who has access to your Microsoft Energy Data Service instance, what they can do with it, and what services they have access to.
14
+
Access management is a critical function for any service or resource. Entitlement service helps you manage who has access to your Azure Data Manager for Energy Preview instance, what they can do with it, and what services they have access to.
15
15
16
16
[!INCLUDE [preview features callout](./includes/preview/preview-callout.md)]
Copy file name to clipboardExpand all lines: articles/energy-data-services/faq-energy-data-services.yml
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -71,5 +71,5 @@ sections:
71
71
72
72
- question: Can I move an Azure Data Manager for Energy Preview resource from one subscription or resource group to another?
73
73
answer: >
74
-
Today, you can't move an Azure Data Manager for Energy Preview resource from one subscription or resource group to another. Instead you can, delete the existing Azure Data Manager for Energy Preview instance in the current resource group or subscription. Create a new Azure Data Manager for Energy Preview instance in the target resource group or subscription. Next, reingest the data into the new Microsoft Energy Data Service instance.
74
+
Today, you can't move an Azure Data Manager for Energy Preview resource from one subscription or resource group to another. Instead you can, delete the existing Azure Data Manager for Energy Preview instance in the current resource group or subscription. Create a new Azure Data Manager for Energy Preview instance in the target resource group or subscription. Next, reingest the data into the new Azure Data Manager for Energy Preview instance.
In this article, you'll know how to manage users in Azure Data Manager for Energy Preview. It uses the [entitlements API](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/tree/master/) and acts as a group-based authorization system for data partitions within Microsoft Energy Data Service instance. For more information about Azure Data Manager for Energy Preview entitlements, see [entitlement services](concepts-entitlements.md).
13
+
In this article, you'll know how to manage users in Azure Data Manager for Energy Preview. It uses the [entitlements API](https://community.opengroup.org/osdu/platform/security-and-compliance/entitlements/-/tree/master/) and acts as a group-based authorization system for data partitions within Azure Data Manager for Energy Preview instance. For more information about Azure Data Manager for Energy Preview entitlements, see [entitlement services](concepts-entitlements.md).
14
14
15
15
[!INCLUDE [preview features callout](./includes/preview/preview-callout.md)]
Copy file name to clipboardExpand all lines: articles/energy-data-services/includes/preview/preview-callout.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,4 +7,5 @@ ms.date: 09/03/2022
7
7
> [!IMPORTANT]
8
8
> Microsoft Azure Data Manager for Energy Preview is currently in preview. For legal terms that apply to features that are in beta, in preview, or otherwise not yet released into general availability, see the [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
9
9
>
10
-
> Azure Data Manager for Energy is now available to all customers and partners during the preview period. Get started with by creating an instance of the product [here](https://aka.ms/MicrosoftEnergyDataServices-create).
10
+
> Azure Data Manager for Energy Preview is now available to all customers and partners during the preview period. Get started with by creating an instance of the product [here](https://aka.ms/MicrosoftEnergyDataServices-create).
The energy industry works with data of an extraordinary magnitude, which has significant ramifications for storage and compute requirements. Geoscientists stream terabytes of seismic, well log, and other data types at full resolution. Immediate responsiveness of data is essential for all stages of petroleum exploration--particularly for geologic interpretation and analysis.
15
15
16
16
## Overview
17
-
Domain data management services (DDMS) store, access, and retrieve metadata and bulk data from applications connected to the data platform. Developers, therefore, use DDMS to deliver seamless and secure consumption of data in the applications they build on Microsoft Energy Data Services Preview. The Microsoft Energy Data Services Preview suite of DDMS adheres to [Open Subsurface Data Universe](https://osduforum.org/) (OSDU™) standards and provides enhancements in performance, geo-availability, and access controls. DDMS service is optimized for each data type and can be extended to accommodate new data types. The DDMS service preserves raw data and offers multi format support and conversion for consuming applications such as Petrel while tracking lineage. Data within the DDMS service is discoverable and governed by entitlement and legal tags.
17
+
Domain data management services (DDMS) store, access, and retrieve metadata and bulk data from applications connected to the data platform. Developers, therefore, use DDMS to deliver seamless and secure consumption of data in the applications they build on Azure Data Manager for Energy Preview. The Azure Data Manager for Energy Preview suite of DDMS adheres to [Open Subsurface Data Universe](https://osduforum.org/) (OSDU™) standards and provides enhancements in performance, geo-availability, and access controls. DDMS service is optimized for each data type and can be extended to accommodate new data types. The DDMS service preserves raw data and offers multi format support and conversion for consuming applications such as Petrel while tracking lineage. Data within the DDMS service is discoverable and governed by entitlement and legal tags.
18
18
19
19
[!INCLUDE [preview features callout](./includes/preview/preview-callout.md)]
20
20
@@ -38,11 +38,11 @@ Domain data management services (DDMS) store, access, and retrieve metadata and
38
38
39
39
### Frictionless Exploration and Production(E&P)
40
40
41
-
The Microsoft Energy Data Services Preview DDMS service enables energy companies to access their data in a manner that is fast, portable, testable and extendible. As a result, they'll achieve unparalleled streaming performance and use the standards and output from OSDU™. The Azure DDMS service will onboard the OSDU™ DDMS and SLB proprietary DMS. Microsoft also continues to contribute to the OSDU™ community DDMS to ensure compatibility and architectural alignment.
41
+
The Azure Data Manager for Energy Preview DDMS service enables energy companies to access their data in a manner that is fast, portable, testable and extendible. As a result, they'll achieve unparalleled streaming performance and use the standards and output from OSDU™. The Azure DDMS service will onboard the OSDU™ DDMS and SLB proprietary DMS. Microsoft also continues to contribute to the OSDU™ community DDMS to ensure compatibility and architectural alignment.
42
42
43
43
### Seamless connection between applications and data
44
44
45
-
Customers can deploy applications on top of Microsoft Energy Data Services Preview that have been developed as per the OSDU™ standard. They're able to connect applications to Core Services and DDMS without spending extensive cycles on deployment. Customers can also easily connect DELFI to Microsoft Energy Data Services Preview, eliminating the cycles associated with Petrel deployments and connection to data management systems. By connecting applications to DDMS service, Geoscientists can execute integrated E&P workflows with unparalleled performance on Azure and use OSDU™ core services. For example, a geophysicist can pick well ties on a seismic volume in Petrel and stream data from the seismic DMS.
45
+
Customers can deploy applications on top of Azure Data Manager for Energy Preview that have been developed as per the OSDU™ standard. They're able to connect applications to Core Services and DDMS without spending extensive cycles on deployment. Customers can also easily connect DELFI to Azure Data Manager for Energy Preview, eliminating the cycles associated with Petrel deployments and connection to data management systems. By connecting applications to DDMS service, Geoscientists can execute integrated E&P workflows with unparalleled performance on Azure and use OSDU™ core services. For example, a geophysicist can pick well ties on a seismic volume in Petrel and stream data from the seismic DMS.
46
46
47
47
## Types of DMS
48
48
Below are the OSDU™ DMS the service supports -
@@ -53,7 +53,7 @@ Seismic data is a fundamental data type for oil and gas exploration. Seismic dat
53
53
54
54
Due to this extraordinary data size, geoscientists working on-premises struggle to use seismic data in domain applications. They suffer from crashes as the seismic dataset exceeds their workstation's RAM, which leads to significant non-productive time. To achieve performance needed for domain workflows, geoscientists must chunk a seismic dataset and view each chunk in isolation. As a result, users suffer from the time spent wrangling seismic data and the opportunity cost of missing the significant picture view of the subsurface and target reservoirs.
55
55
56
-
The seismic DMS is part of the OSDU™ platform and enables users to connect seismic data to cloud storage to applications. It allows secure access to metadata associated with seismic data to efficiently retrieve and handle large blocks of data for OpenVDS, ZGY, and other seismic data formats. The DMS therefore enables users to stream huge amounts of data in OSDU™ compliant applications in real time. Enabling the seismic DMS on Microsoft Energy Data Services Preview opens a pathway for Azure customers to bring their seismic data to the cloud and take advantage of Azure storage and high performance computing.
56
+
The seismic DMS is part of the OSDU™ platform and enables users to connect seismic data to cloud storage to applications. It allows secure access to metadata associated with seismic data to efficiently retrieve and handle large blocks of data for OpenVDS, ZGY, and other seismic data formats. The DMS therefore enables users to stream huge amounts of data in OSDU™ compliant applications in real time. Enabling the seismic DMS on Azure Data Manager for Energy Preview opens a pathway for Azure customers to bring their seismic data to the cloud and take advantage of Azure storage and high performance computing.
Copy file name to clipboardExpand all lines: articles/reliability/reliability-energy-data-services.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,6 @@
1
1
---
2
-
title: Reliability in Azure Microsoft Energy Data Services
3
-
description: Find out about reliability in Microsoft Energy Data Services
2
+
title: Reliability in Microsoft Azure Data Manager for Energy Preview
3
+
description: Find out about reliability in Azure Data Manager for Energy Preview
4
4
author: bharathim
5
5
ms.author: anaharris
6
6
ms.topic: conceptual
@@ -10,19 +10,19 @@ ms.date: 01/13/2023
10
10
---
11
11
12
12
13
-
# Reliability in Microsoft Energy Data Services
13
+
# What is reliability in Azure Data Manager for Energy Preview?
14
14
15
-
This article describes reliability support in Microsoft Energy Data Services, and covers intra-regional resiliency with [availability zones](#availability-zone-support). For a more detailed overview of reliability in Azure, see [Azure reliability](../reliability/overview.md).
15
+
This article describes reliability support in Azure Data Manager for Energy Preview, and covers intra-regional resiliency with [availability zones](#availability-zone-support). For a more detailed overview of reliability in Azure, see [Azure reliability](../reliability/overview.md).
16
16
17
17
## Availability zone support
18
18
19
19
Azure availability zones are at least three physically separate groups of datacenters within each Azure region. Datacenters within each zone are equipped with independent power, cooling, and networking infrastructure. If there's a local zone failure, availability zones are designed so that if the one zone is affected, regional services, capacity, and high availability are supported by the remaining two zones. Failures can range from software and hardware failures to events such as earthquakes, floods, and fires. Tolerance to failures is achieved with redundancy and logical isolation of Azure services. For more detailed information on availability zones in Azure, see [Regions and availability zones](availability-zones-overview.md).
20
20
21
-
Microsoft Energy Data Services Preview supports zone-redundant instance by default and there's no setup required by the Customer.
21
+
Azure Data Manager for Energy Preview supports zone-redundant instance by default and there's no setup required by the Customer.
22
22
23
23
### Prerequisites
24
24
25
-
The Microsoft Energy Data Services Preview supports availability zones in the following regions:
25
+
The Azure Data Manager for Energy Preview supports availability zones in the following regions:
26
26
27
27
| Americas | Europe | Middle East | Africa | Asia Pacific |
@@ -32,7 +32,7 @@ The Microsoft Energy Data Services Preview supports availability zones in the fo
32
32
### Zone down experience
33
33
During a zone-wide outage, no action is required during zone recovery. There may be a brief degradation of performance until the service self-heals and re-balances underlying capacity to adjust to healthy zones.
34
34
35
-
If you're experiencing failures with Microsoft Energy Data Services APIs, you may need to implement a retry mechanism for 5XX errors.
35
+
If you're experiencing failures with Azure Data Manager for Energy PreviewAPIs, you may need to implement a retry mechanism for 5XX errors.
0 commit comments