Skip to content

Commit 5bcd433

Browse files
authored
Merge pull request #193379 from sipastak/db-copy-service
Data Box copy service updates
2 parents 8720a4f + ef80f89 commit 5bcd433

File tree

2 files changed

+33
-16
lines changed

2 files changed

+33
-16
lines changed

articles/databox/data-box-deploy-copy-data-via-copy-service.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,13 +8,13 @@ author: alkohli
88
ms.service: databox
99
ms.subservice: pod
1010
ms.topic: tutorial
11-
ms.date: 03/11/2021
11+
ms.date: 04/04/2021
1212
ms.author: alkohli
1313
#Customer intent: As an IT admin, I need to be able to copy data to Data Box to upload on-premises data from my server onto Azure.
1414
---
1515
# Tutorial: Use the data copy service to copy data into Azure Data Box (preview)
1616

17-
This tutorial describes how to ingest data by using the data copy service without an intermediate host. The data copy service runs locally on Microsoft Azure Data Box, connects to your network-attached storage (NAS) device via SMB, and copies data to Data Box.
17+
This tutorial describes how to ingest data by using the data copy service without an intermediate host. The data copy service runs locally on Microsoft Azure Data Box, connects to your network-attached storage (NAS) device via SMB, and copies data to Data Box.
1818

1919
Use the data copy service:
2020

@@ -68,7 +68,7 @@ To copy data by using the data copy service, you need to create a job:
6868
|**Destination type** |Select the target storage type from the list: **Block Blob**, **Page Blob**, **Azure Files**, or **Block Blob (Archive)**. |
6969
|**Destination container/share** |Enter the name of the container or share that you want to upload data to in your destination storage account. The name can be a share name or a container name. For example, use `myshare` or `mycontainer`. You can also enter the name in the format `sharename\directory_name` or `containername\virtual_directory_name`. |
7070
|**Copy files matching pattern** | You can enter the file-name matching pattern in the following two ways:<ul><li>**Use wildcard expressions:** Only `*` and `?` are supported in wildcard expressions. For example, the expression `*.vhd` matches all the files that have the `.vhd` extension. Similarly, `*.dl?` matches all the files with either the extension `.dl` or that start with `.dl`, such as `.dll`. Likewise, `*foo` matches all the files whose names end with `foo`.<br>You can directly enter the wildcard expression in the field. By default, the value you enter in the field is treated as a wildcard expression.</li><li>**Use regular expressions:** POSIX-based regular expressions are supported. For example, the regular expression `.*\.vhd` will match all the files that have the `.vhd` extension. For regular expressions, provide the `<pattern>` directly as `regex(<pattern>)`. For more information about regular expressions, go to [Regular expression language - a quick reference](/dotnet/standard/base-types/regular-expression-language-quick-reference).</li><ul>|
71-
|**File optimization** |When this feature is enabled, files smaller than 1 MB are packed during ingestion. This packing speeds up the data copy for small files. It also saves a significant amount of time when the number of files far exceeds the number of directories.</br>If you use file optimization:<ul><li>After you run prepare to ship, you can [download a BOM file](data-box-logs.md#inspect-bom-during-prepare-to-ship), which lists the original file names, to help you ensure that all the right files are copied.</li><li>Don't delete the packed files, whose file names begin with "ADB_PACK_". If you delete a packed file, the original file isn't uploaded during future data copies.</li><li>Don't copy the same files that you copy with the Copy Service via other protocols such as SMB, NFS, or REST API. Using different protocols can result in conflicts and failure during data uploads. </li></ul> |
71+
|**File optimization** |When this feature is enabled, files smaller than 1 MB are packed during ingestion. This packing speeds up the data copy for small files. It also saves a significant amount of time when the number of files far exceeds the number of directories.</br>If you use file optimization:<ul><li>After you run prepare to ship, you can [download a BOM file](data-box-logs.md#inspect-bom-during-prepare-to-ship), which lists the original file names, to help you ensure that all the right files are copied.</li><li>Don't delete the packed files, whose file names begin with "ADB_PACK_". If you delete a packed file, the original file isn't uploaded during future data copies.</li><li>Don't copy the same files that you copy with the Copy Service via other protocols such as SMB, NFS, or REST API. Using different protocols can result in conflicts and failure during data uploads. </li><li>File optimization is not supported for Azure Files. To see what timestamps, file attributes, and ACLs are copied for a non-optimized data copy job, view the [transferred metadata](data-box-file-acls-preservation.md). </li></ul> |
7272

7373
4. Select **Start**. The inputs are validated, and if the validation succeeds, then the job starts. It might take a few minutes for the job to start.
7474

articles/databox/data-box-file-acls-preservation.md

Lines changed: 30 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -7,32 +7,32 @@ author: alkohli
77
ms.service: databox
88
ms.subservice: pod
99
ms.topic: conceptual
10-
ms.date: 01/21/2022
10+
ms.date: 04/11/2022
1111
ms.author: alkohli
1212
---
1313

1414
# Preserving file ACLs, attributes, and timestamps with Azure Data Box
1515

1616
Azure Data Box lets you preserve access control lists (ACLs), timestamps, and file attributes when sending data to Azure. This article describes the metadata that you can transfer when copying data to Data Box via Server Message Block (SMB) to upload it to Azure Files.
1717

18-
Specific steps are provided to copy metadata with Windows and Linux data copy tools. Metadata isn't preserved when transferring data to blob storage.
18+
## Transferred metadata
1919

20-
In this article, the ACLs, timestamps, and file attributes that are transferred are referred to collectively as *metadata*.
20+
ACLs, timestamps, and file attributes are the metadata that is transferred when the data from Data Box is uploaded to Azure Files. In this article, ACLs, timestamps, and file attributes are referred to collectively as *metadata*.
2121

22-
## Transferred metadata
22+
The metadata can be copied with Windows and Linux data copy tools. Metadata isn't preserved when transferring data to blob storage.
2323

24-
The following metadata is transferred when data from the Data Box is uploaded to Azure Files.
24+
The subsequent sections of the article discuss in detail as to how the timestamps, file attributes, and ACLs are transferred when the data from Data Box is uploaded to Azure Files.
2525

26-
#### Timestamps
26+
## Timestamps
2727

2828
The following timestamps are transferred:
2929
- CreationTime
3030
- LastWriteTime
3131

3232
The following timestamp isn't transferred:
3333
- LastAccessTime
34-
35-
#### File attributes
34+
35+
## File attributes
3636

3737
File attributes on both files and directories are transferred unless otherwise noted.
3838

@@ -51,7 +51,7 @@ The following file attributes aren't transferred:
5151

5252
Read-only attributes on directories aren't transferred.
5353

54-
#### ACLs
54+
## ACLs
5555

5656
<!--ACLs DEFINITION
5757
@@ -78,16 +78,33 @@ Transfer of ACLs is enabled by default. You might want to disable this setting i
7878
> [!NOTE]
7979
> Files with ACLs containing conditional access control entry (ACE) strings are not copied. This is a known issue. To work around this, copy these files to the Azure Files share manually by mounting the share and then using a copy tool that supports copying ACLs.
8080
81-
**ACLs transfer over SMB**
81+
### ACLs transfer over SMB
8282

8383
During an [SMB file transfer](./data-box-deploy-copy-data.md), the following ACLs are transferred:
8484

85-
- Discretionary ACLs (DACLs) and system ACLs (SACLs) for directories and files that you copy to your Data Box
85+
- Discretionary ACLs (DACLs) and system ACLs (SACLs) for directories and files that you copy to your Data Box.
8686
- If you use a Linux client, only Windows NT ACLs are transferred.<!--Kyle asked: What are Windows NT ACLs.-->
8787

88-
ACLs aren't transferred when you [copy data over NFS](./data-box-deploy-copy-data-via-nfs.md) or [use the data copy service](data-box-deploy-copy-data-via-copy-service.md). The data copy service reads data directly from your shares and can't read ACLs.
88+
### ACLs transfer over Data Copy Service
89+
90+
During a [data copy service file transfer](data-box-deploy-copy-data-via-copy-service.md), the following ACLs are transferred:
91+
92+
- Discretionary ACLs (DACLs) and system ACLs (SACLs) for directories and files that you copy to your Data Box.
93+
94+
To copy SACLs from your files, you must provide credentials for a user with **SeBackupPrivilege**. Users in the Administrators or Backup Operators group will have this privilege by default
95+
96+
If you do not have **SeBackupPrivilege**:
97+
- You will not be able to copy SACLs for Azure Files copy service jobs.
98+
- You may experience access issues and receive this error in the error log: *Could not read SACLs from share due to insufficient privileges*.
99+
100+
For more information, learn more about [SeBackupPrivilege](/windows/win32/secauthz/privilege-constants).
101+
102+
### ACLs transfer over NFS
103+
104+
ACLs aren't transferred when you copy data over [NFS](data-box-deploy-copy-data-via-nfs.md).
105+
89106

90-
**Default ACLs transfer**
107+
### Default ACLs transfer
91108

92109
Even if your data copy tool doesn't copy ACLs, the default ACLs on directories and files are transferred to Azure Files when you use a Windows client. The default ACLs aren't transferred when you use a Linux client.
93110

0 commit comments

Comments
 (0)