You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hpc-cache/hpc-cache-add-storage.md
+2-21Lines changed: 2 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,17 +4,15 @@ description: How to define storage targets so that your Azure HPC Cache can use
4
4
author: ekpgh
5
5
ms.service: hpc-cache
6
6
ms.topic: how-to
7
-
ms.date: 10/05/2022
7
+
ms.date: 2/15/2023
8
8
ms.custom: subject-rbac-steps
9
-
ms.author: v-erinkelly
9
+
ms.author: kianaharris
10
10
---
11
11
12
12
# Add storage targets
13
13
14
14
*Storage targets* are back-end storage for files that are accessed through an Azure HPC Cache. You can add NFS storage (like an on-premises hardware system), or store data in Azure Blob.
15
15
16
-
You can define 10 different storage targets for any cache, and larger caches can [support up to 20 storage targets](#size-your-cache-correctly-to-support-your-storage-targets).
17
-
18
16
The cache presents all of the storage targets in one [aggregated namespace](hpc-cache-namespace.md). The namespace paths are configured separately after you add the storage targets.
19
17
20
18
Remember that the storage exports must be accessible from your cache's virtual network. For on-premises hardware storage, you might need to set up a DNS server that can resolve hostnames for NFS storage access. Read more in [DNS access](hpc-cache-prerequisites.md#dns-access).
@@ -31,23 +29,6 @@ The procedure to add a storage target is slightly different depending on the typ
31
29
32
30
[](https://azure.microsoft.com/resources/videos/set-up-hpc-cache/) -->
33
31
34
-
## Size your cache correctly to support your storage targets
35
-
36
-
When you create the cache, make sure you select the type and size that will support the number of storage targets you need.
37
-
38
-
The number of supported storage targets depends on the cache type and the cache capacity. Cache capacity is a combination of throughput capacity (in GB/s) and storage capacity (in TB).
39
-
40
-
* Up to 10 storage targets - A standard cache with the smallest or medium cache storage value for your selected throughput can have a maximum of 10 storage targets.
41
-
42
-
For example, if you choose 2 GB/second throughput and don't choose the largest cache storage size (12 TB), your cache supports a maximum of 10 storage targets.
43
-
44
-
* Up to 20 storage targets -
45
-
46
-
* All read-only high-throughput caches (which have preconfigured cache storage sizes) can support up to 20 storage targets.
47
-
* Standard caches can support up to 20 storage targets if you choose the highest available cache size for your selected throughput value. (If using Azure CLI, choose the highest valid cache size for your cache SKU.)
48
-
49
-
Read [Choose cache type and capacity](hpc-cache-create.md#choose-cache-type-and-capacity) to learn more about throughput and cache size settings.
50
-
51
32
## Choose the correct storage target type
52
33
53
34
You can select from three storage target types: **NFS**, **Blob**, and **ADLS-NFS**. Choose the type that matches the kind of storage system you'll use to store your files during this HPC Cache project.
@@ -48,19 +48,28 @@ On the **Cache** page, specify the type and size of cache to create. These value
48
48
* How many storage targets it can have
49
49
* The cache's cost
50
50
51
-
First, choose the type of cache you want. Options include:
51
+

52
52
53
-
***Read-write standard caching** - A flexible, general-purpose cache
54
-
***Read-only caching** - A high-throughput cache designed to minimize latency for file access
53
+
Before you can choose throughput or storage capacity, you need to choose the cache type. Options include:
55
54
56
-
Read more about these cache type options below in [Choose the cache type for your needs](#choose-the-cache-type-for-your-needs).
55
+
* Read-write standard caching: A flexible general-purpose cache
56
+
* Read-only caching: A high-throughput cache designed to minimize file access latency; modifications are handled with synchronous write-through operations
57
+
* Read-write premium caching (Preview): An NVMe-optimized cache with the lowest latency and highest throughput
58
+
<!-- * Read-only scalable standard caching (Preview): A general-purpose cache that can be made larger or smaller (at predefined sizes) to accommodate variable workloads -->
57
59
58
-
Second, select the cache's capacity. Cache capacity is a combination of two values:
60
+

61
+
62
+
Read more about these cache types below in [Choose the cache type for your needs](#choose-the-cache-type-for-your-needs).
63
+
64
+
> [!TIP]
65
+
> "Read-write" cache types can be configured with storage targets using either read caching or read-write caching usage models. "Read-only" cache types only support NFS and ADLS-NFS storage target types with read-caching usage models only. Learn more about caching modes in [Understand cache usage models](cache-usage-models.md).
66
+
67
+
The "Standard" cache SKU lets you choose the cache's capacity for a given throughput selection, while the "Premium" and "read-only" caches have fixed capacities for each given throughput selection. The cache's capabilities are defined by two deployment choices:
59
68
60
69
***Maximum throughput** - The data transfer rate for the cache, in GB/second
61
70
***Cache size** - The amount of storage allocated for cached data, in TB
62
71
63
-

72
+

64
73
65
74
### Understand throughput and cache size
66
75
@@ -74,39 +83,54 @@ Azure HPC Cache manages which files are cached and pre-loaded to maximize cache
74
83
75
84
Choose a cache storage size that can comfortably hold the active set of working files, plus additional space for metadata and other overhead.
76
85
77
-
Throughput and cache size also affect how many storage targets are supported for a particular cache. If you want to use more than 10 storage targets with your cache, you must choose the highest available cache storage size value available for your throughput size, or choose the high-throughput read-only configuration. Learn more in [Add storage targets](hpc-cache-add-storage.md#size-your-cache-correctly-to-support-your-storage-targets).
78
-
79
86
If you need help sizing your cache correctly, contact Microsoft Service and Support.
80
87
88
+
81
89
### Choose the cache type for your needs
82
90
83
-
When you choose your cache capacity, you might notice that some cache types have one fixed cache size, and others let you select from multiple cache size options for each throughput value. This is because they use different styles of cache infrastructure.
91
+
There are two basic cache types: "standard" and "premium".
92
+
93
+
**Standard** caches are general-use HPC Cache systems. You can select from multiple storage sizes after choosing your throughput value, and you can attach any of the HPC Cache supported storage target types.
94
+
95
+
**Premium** caches are designed for the highest-performance file service. They use high-throughput NVMe storage devices, which means that premium caches have a different pricing structure, static cache capacities, and cannot be temporarily stopped.
96
+
97
+
Cache options include:
98
+
99
+
***Read-write standard caching**
100
+
101
+
With standard caches, you can choose from several cache size values. These caches can be configured with storage target usage models for both read (write-through) and read-write caching.
102
+
103
+
***Read-only caching**
104
+
105
+
This type of cache provides higher throughput and lower latency than a standard cache, but is designed to optimize file and directory read access only. You cannot configure a read-only cache to use read-write cache usage models, but a read-after-write workload will result in a cache-hit, as the writes are persisted synchronously to the storage target. This type of cache has only one cache size option for each throughput choice.
106
+
107
+
***Read-write premium caching (Preview)**
108
+
109
+
A high-throughput cache that can be configured for either read-only or read-write caching. These caches have only one cache size option for each throughput option.
84
110
85
-
* Standard caches - Cache type **Read-write caching**
111
+
<!-- * **Read-only scalable caching (Preview)**
86
112
87
-
With standard caches, you can choose from several cache size values. These caches can be configured for read-only or for read and write caching.
113
+
A standard throughput cache that can be made larger or smaller to accommodate variable workflows. You can choose from a variety of storage sizes for each throughput size.
88
114
89
-
* High-throughput caches - Cache type **Read-only caching**
115
+
> [!NOTE]
116
+
> For a scalable cache, the values you choose at create time determine the size options you will have when scaling the cache up or down later. Choose the highest throughput and largest storage size if you want to be able to maximize these values later.
90
117
91
-
The high-throughput read-only caches are preconfigured with only one cache size option per throughput value. They're designed to optimize file read access only.
118
+
Read [Use scalable caches](scale-cache.md) to learn more about creating and using scalable caches. -->
92
119
93
-

120
+
This table explains important differences among the three cache types.
94
121
95
-
This table explains some important differences between the two options.
| Cache can be stopped to save cost when not needed | Yes | No | No |
96
129
97
-
| Attribute | Standard cache | Read-only high-throughput cache |
98
-
|--|--|--|
99
-
| Cache type |"Read-write standard caching"| "Read-only caching"|
100
-
| Throughput sizes | 2, 4, or 8 GB/sec | 4.5, 9, or 16 GB/sec |
101
-
| Cache sizes | 3, 6, or 12 TB for 2 GB/sec<br/> 6, 12, or 24 TB for 4 GB/sec<br/> 12, 24, or 48 TB for 8 GB/sec| 21 TB for 4.5 GB/sec <br/> 42 TB for 9 GB/sec <br/> 84 TB for 16 GB/sec |
102
-
| Maximum number of storage targets |[10 or 20](hpc-cache-add-storage.md#size-your-cache-correctly-to-support-your-storage-targets) depending on cache size selection | 20 |
103
-
| Compatible storage target types | Azure Blob, on-premises NFS storage, NFS-enabled blob | on-premises NFS storage <br/>NFS-enabled blob storage is in preview for this combination |
104
-
| Caching styles | Read caching or read-write caching | Read caching only |
105
-
| Cache can be stopped to save cost when not needed | Yes | No |
130
+
All three caching options have a maximum storage target count of 20.
106
131
107
132
Learn more about these options:
108
133
109
-
*[Maximum number of storage targets](hpc-cache-add-storage.md#size-your-cache-correctly-to-support-your-storage-targets)
110
134
*[Read and write caching modes](cache-usage-models.md#basic-file-caching-concepts)
111
135
112
136
## Enable Azure Key Vault encryption (optional)
@@ -194,7 +218,7 @@ Supply these values:
194
218
| 24576 GB | no | yes | yes |
195
219
| 49152 GB | no | no | yes |
196
220
197
-
If you want to use more than 10 storage targets with your cache, choose the highest available cache size value for your SKU. These configurations support up to 20 storage targets.
221
+
<!--If you want to use more than 10 storage targets with your cache, choose the highest available cache size value for your SKU. These configurations support up to 20 storage targets.-->
198
222
199
223
Read the **Set cache capacity** section in the portal instructions tab for important information about pricing, throughput, and how to size your cache appropriately for your workflow.
Copy file name to clipboardExpand all lines: articles/hpc-cache/hpc-cache-netapp.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -45,7 +45,7 @@ Use the minimum size for the delegated subnet when creating an Azure NetApp File
45
45
46
46
The minimum size, which is specified with the netmask /28, provides 16 IP addresses. In practice, Azure NetApp Files uses only three of those available IP addresses for volume access. This means that you only need to create three storage targets in your Azure HPC Cache to cover all of the volumes.
47
47
48
-
If the delegated subnet is too large, it's possible for the Azure NetApp Files volumes to use more IP addresses than a single Azure HPC Cache instance can handle. A single cache has a [limit of 10 storage targets](hpc-cache-add-storage.md#size-your-cache-correctly-to-support-your-storage-targets) for most cache throughput/storage size combinations, or 20 storage targets for the largest configurations.
48
+
If the delegated subnet is too large, it's possible for the Azure NetApp Files volumes to use more IP addresses than a single Azure HPC Cache instance can handle.
49
49
50
50
The quickstart example in Azure NetApp Files documentation uses 10.7.0.0/16 for the delegated subnet, which gives a subnet that's too large.
Copy file name to clipboardExpand all lines: articles/hpc-cache/hpc-cache-prerequisites.md
+2-4Lines changed: 2 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,8 +4,8 @@ description: Prerequisites for using Azure HPC Cache
4
4
author: ekpgh
5
5
ms.service: hpc-cache
6
6
ms.topic: how-to
7
-
ms.date: 12/30/2022
8
-
ms.author: v-erinkelly
7
+
ms.date: 2/15/2023
8
+
ms.author: kianaharris
9
9
---
10
10
11
11
# Prerequisites for Azure HPC Cache
@@ -169,8 +169,6 @@ Check these permission-related prerequisites before starting to create your cach
169
169
170
170
The cache supports Azure Blob containers, NFS hardware storage exports, and NFS-mounted ADLS blob containers. Add storage targets after you create the cache.
171
171
172
-
The size of your cache determines the number of storage targets it can support - up to 10 storage targets for most caches, or up to 20 for the largest sizes. Read [Size your cache correctly to support your storage targets](hpc-cache-add-storage.md#size-your-cache-correctly-to-support-your-storage-targets) for details.
0 commit comments