Skip to content

Commit 18015fc

Browse files
authored
Merge pull request #102562 from normesta/normesta-azcopy
Some text for a new feature
2 parents f4d8127 + fb526ab commit 18015fc

File tree

2 files changed

+18
-2
lines changed

2 files changed

+18
-2
lines changed

articles/storage/common/storage-ref-azcopy-copy.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -212,7 +212,7 @@ Copy a subset of buckets by using a wildcard symbol (*) in the bucket name. Like
212212

213213
**--no-guess-mime-type** Prevents AzCopy from detecting the content-type based on the extension or content of the file.
214214

215-
**--overwrite** string Overwrite the conflicting files and blobs at the destination if this flag is set to true. Possible values include 'true', 'false', and 'prompt'. (default "true")
215+
**--overwrite** string Overwrite the conflicting files and blobs at the destination if this flag is set to true. Possible values include 'true', 'false', 'ifSourceNewer', and 'prompt'. (default "true")
216216

217217
**--page-blob-tier** string Upload page blob to Azure Storage using this blob tier. (default "None")
218218

articles/storage/common/storage-use-azcopy-configure.md

Lines changed: 17 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ description: Configure, optimize, and troubleshoot AzCopy.
44
author: normesta
55
ms.service: storage
66
ms.topic: conceptual
7-
ms.date: 10/16/2019
7+
ms.date: 01/28/2020
88
ms.author: normesta
99
ms.subservice: common
1010
ms.reviewer: dineshm
@@ -37,6 +37,14 @@ Currently, AzCopy doesn't support proxies that require authentication with NTLM
3737

3838
You can benchmark performance, and then use commands and environment variables to find an optimal tradeoff between performance and resource consumption.
3939

40+
This section helps you perform these optimization tasks:
41+
42+
> [!div class="checklist"]
43+
> * Run benchmark tests
44+
> * Optimize throughput
45+
> * Optimize memory use
46+
> * Optimize file synchronization
47+
4048
### Run benchmark tests
4149

4250
You can run a performance benchmark test on specific blob containers to view general performance statistics and to identity performance bottlenecks.
@@ -93,6 +101,14 @@ Express this value in gigabytes (GB).
93101
| **Linux** | `export AZCOPY_BUFFER_GB=<value>` |
94102
| **MacOS** | `export AZCOPY_BUFFER_GB=<value>` |
95103

104+
### Optimize file synchronization
105+
106+
The [sync](storage-ref-azcopy-sync.md) command identifies all files at the destination, and then compares file names and last modified timestamps before the starting the sync operation. If you have a large number of files, then you can improve performance by eliminating this up-front processing.
107+
108+
To accomplish this, use the [azcopy copy](storage-ref-azcopy-copy.md) command instead, and set the `--overwrite` flag to `ifSourceNewer`. AzCopy will compare files as they are copied without performing any up-front scans and comparisons. This provides a performance edge in cases where there are a large number of files to compare.
109+
110+
The [azcopy copy](storage-ref-azcopy-copy.md) command doesn't delete files from the destination, so if you want to delete files at the destination when they no longer exist at the source, then use the [azcopy sync](storage-ref-azcopy-sync.md) command with the `--delete-destination` flag set to a value of `true` or `prompt`.
111+
96112
## Troubleshoot issues
97113

98114
AzCopy creates log and plan files for every job. You can use the logs to investigate and troubleshoot any potential problems.

0 commit comments

Comments
 (0)