You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-add-storage.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: How to add a back-end storage system to your Avere vFXT for Azure
4
4
author: ekpgh
5
5
ms.service: avere-vfxt
6
6
ms.topic: conceptual
7
-
ms.date: 12/14/2019
7
+
ms.date: 01/13/2020
8
8
ms.author: rohogue
9
9
---
10
10
@@ -27,7 +27,7 @@ These steps use the Avere Control Panel. Read [Access the vFXT cluster](avere-vf
27
27
28
28
## Create a core filer
29
29
30
-
"Core filer" is a vFXT term for a backend storage system. The storage can be a hardware NAS appliance like NetApp or Isilon, or it can be a cloud object store. More information about core filers can be found in the [Avere cluster settings guide](https://azure.github.io/Avere/legacy/ops_guide/4_7/html/settings_overview.html#managing-core-filers).
30
+
"Core filer" is a vFXT term for a back-end storage system. The storage can be a hardware NAS appliance like NetApp or Isilon, or it can be a cloud object store. More information about core filers can be found in the [Avere cluster settings guide](https://azure.github.io/Avere/legacy/ops_guide/4_7/html/settings_overview.html#managing-core-filers).
31
31
32
32
To add a core filer, choose one of the two main types of core filers:
33
33
@@ -64,7 +64,7 @@ Next, proceed to [Create a junction](#create-a-junction).
64
64
65
65
### Azure Blob Storage cloud core filer
66
66
67
-
To use Azure Blob storage as your vFXT cluster's backend storage, you need an empty container to add as a core filer.
67
+
To use Azure Blob storage as your vFXT cluster's back-end storage, you need an empty container to add as a core filer.
68
68
69
69
Adding Blob storage to your cluster requires these tasks:
Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-additional-resources.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Links to additional information about Avere vFXT for Azure
4
4
author: ekpgh
5
5
ms.service: avere-vfxt
6
6
ms.topic: conceptual
7
-
ms.date: 12/19/2019
7
+
ms.date: 01/13/2020
8
8
ms.author: rohogue
9
9
---
10
10
@@ -20,7 +20,7 @@ Additional Avere cluster documentation can be found on the website at <https://a
20
20
*[Customizing Support and Monitoring Settings](<https://azure.github.io/Avere/legacy/create_cluster/4_8/html/config_support.html#config-support>) explains how to customize support upload settings and enable remote monitoring.
21
21
*[Configuring VServers and Global Namespace](<https://azure.github.io/Avere/legacy/create_cluster/4_8/html/config_vserver.html#config-vserver>) has information about creating a client-facing namespace.
22
22
*[Configuring DNS for the Avere cluster](<https://azure.github.io/Avere/legacy/create_cluster/4_8/html/config_network.html#dns-overview>) explains how to configure round-robin DNS.
23
-
*[Adding Backend Storage](<https://azure.github.io/Avere/legacy/create_cluster/4_8/html/config_core_filer.html#add-core-filer>) documents how to add core filers.
23
+
*[Adding Back-end Storage](<https://azure.github.io/Avere/legacy/create_cluster/4_8/html/config_core_filer.html#add-core-filer>) documents how to add core filers.
24
24
25
25
* The [Cluster Configuration Guide](<https://azure.github.io/Avere/#operations>) is a complete reference of settings and options for an Avere cluster. A vFXT cluster uses a subset of these options, but most of the same configuration pages apply.
Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-data-ingest.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ ms.author: rohogue
10
10
11
11
# Moving data to the vFXT cluster - Parallel data ingest
12
12
13
-
After you've created a new vFXT cluster, your first task might be to move data onto a new storage volume in Azure. However, if your usual method of moving data is issuing a simple copy command from one client, you will likely see a slow copy performance. Single-threaded copying is not a good option for copying data to the Avere vFXT cluster's backend storage.
13
+
After you've created a new vFXT cluster, your first task might be to move data onto a new storage volume in Azure. However, if your usual method of moving data is issuing a simple copy command from one client, you will likely see a slow copy performance. Single-threaded copying is not a good option for copying data to the Avere vFXT cluster's back-end storage.
14
14
15
15
Because the Avere vFXT for Azure cluster is a scalable multi-client cache, the fastest and most efficient way to copy data to it is with multiple clients. This technique parallelizes ingestion of the files and objects.
16
16
@@ -273,7 +273,7 @@ This method is a simple and time-effective method for datasets up to the number
273
273
274
274
## Use the msrsync utility
275
275
276
-
The ``msrsync`` tool also can be used to move data to a backend core filer for the Avere cluster. This tool is designed to optimize bandwidth usage by running multiple parallel ``rsync`` processes. It is available from GitHub at <https://github.com/jbd/msrsync>.
276
+
The ``msrsync`` tool also can be used to move data to a back-end core filer for the Avere cluster. This tool is designed to optimize bandwidth usage by running multiple parallel ``rsync`` processes. It is available from GitHub at <https://github.com/jbd/msrsync>.
277
277
278
278
``msrsync`` breaks up the source directory into separate “buckets” and then runs individual ``rsync`` processes on each bucket.
279
279
@@ -318,7 +318,7 @@ To use ``msrsync`` to populate an Azure cloud volume with an Avere cluster, foll
318
318
319
319
## Use the parallel copy script
320
320
321
-
The ``parallelcp`` script also can be useful for moving data to your vFXT cluster's backend storage.
321
+
The ``parallelcp`` script also can be useful for moving data to your vFXT cluster's back-end storage.
322
322
323
323
The script below will add the executable `parallelcp`. (This script is designed for Ubuntu; if using another distribution, you must install ``parallel`` separately.)
Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-deploy-overview.md
+7-5Lines changed: 7 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Overview of deploying Avere vFXT for Azure
4
4
author: ekpgh
5
5
ms.service: avere-vfxt
6
6
ms.topic: conceptual
7
-
ms.date: 01/09/2020
7
+
ms.date: 01/13/2020
8
8
ms.author: rohogue
9
9
---
10
10
<!-- filename is linked to in the marketplace template, make sure it gets a redirect if we rename it -->
@@ -36,21 +36,23 @@ Here is an overview of all of the steps.
36
36
Cluster creation involves these steps, which are all done by the marketplace template:
37
37
38
38
* Create new network infrastructure and resource groups, if needed
39
-
* Create a *cluster controller*
39
+
* Create a cluster controller
40
40
41
41
The cluster controller is a simple VM that resides in the same virtual network as the Avere vFXT cluster and has the custom software needed to create and manage the cluster. The controller creates the vFXT nodes and forms the cluster, and it also provides a command-line interface to manage the cluster during its lifetime.
42
42
43
-
If you create a new virtual network or subnet during the deployment, your controller will have a public IP address. This means the controller can serve as a jump host for connecting to the cluster from outside the subnet.
43
+
If you create a new virtual network or subnet during the deployment, your controller will have a public IP address. This means the controller can serve as a jump host for connecting to the cluster from outside the virtual network.
44
44
45
45
* Create the cluster node VMs
46
46
47
-
*Configure the cluster node VMs to form the cluster
47
+
*Create the cluster from the individual nodes
48
48
49
49
* Optionally, create a new Blob container and configure it as back-end storage for the cluster
50
50
51
+
Cluster creation is described in detail in [Deploy the vFXT cluster](avere-vft-deploy.md).
52
+
51
53
1. Configure the cluster
52
54
53
-
Connect to the Avere vFXT configuration interface (Avere Control Panel) to customize the cluster's settings. Opt in for support monitoring, and add your storage system if you are using an on-premises data center.
55
+
Connect to the Avere vFXT configuration interface (Avere Control Panel) to customize the cluster's settings. Opt in for support monitoring, and add your storage system if you are using hardware storage or additional Blob containers.
54
56
55
57
*[Access the vFXT cluster](avere-vfxt-cluster-gui.md)
Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-deploy-plan.md
+14-16Lines changed: 14 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Explains planning to do before deploying Avere vFXT for Azure
4
4
author: ekpgh
5
5
ms.service: avere-vfxt
6
6
ms.topic: conceptual
7
-
ms.date: 01/09/2020
7
+
ms.date: 01/13/2020
8
8
ms.author: rohogue
9
9
---
10
10
@@ -41,9 +41,9 @@ Consider where the elements of your Avere vFXT for Azure deployment will be. The
41
41
42
42

43
43
44
-
Follow these guidelines when planning your Avere vFXT system's network infrastructure:
44
+
Follow these guidelines when planning your Avere vFXT cluster's network infrastructure:
45
45
46
-
* Create a new subscription for each Avere vFXT for Azure deployment and manage all components in this subscription.
46
+
* Create a new subscription for each Avere vFXT for Azure deployment. Manage all components in this subscription.
47
47
48
48
Benefits of using a new subscription for each deployment include:
49
49
* Simpler cost tracking - View and audit all costs from resources, infrastructure, and compute cycles in one subscription.
@@ -56,7 +56,7 @@ Follow these guidelines when planning your Avere vFXT system's network infrastru
56
56
57
57
* In the same virtual network
58
58
* In the same resource group
59
-
*In the same storage account
59
+
*Using the same storage account
60
60
61
61
The cluster creation template handles this configuration for most situations.
62
62
@@ -71,7 +71,7 @@ Follow these guidelines when planning your Avere vFXT system's network infrastru
71
71
| Resource group | Yes, if empty | Must be empty|
72
72
| Storage account |**Yes** if connecting an existing Blob container after cluster creation <br/> **No** if creating a new Blob container during cluster creation | Existing Blob container must be empty <br/> |
73
73
| Virtual network | Yes | Must include a storage service endpoint if creating a new Azure Blob container |
74
-
| Subnet | Yes ||
74
+
| Subnet | Yes |Cannot contain other resources|
75
75
76
76
## IP address requirements
77
77
@@ -81,7 +81,7 @@ The Avere vFXT cluster uses the following IP addresses:
81
81
82
82
* One cluster management IP address. This address can move from node to node in the cluster as needed so that it is always available. Use this address to connect to the Avere Control Panel configuration tool.
83
83
* For each cluster node:
84
-
* At least one client-facing IP address. (All client-facing addresses are managed by the cluster's *vserver*, which can move them among nodes as needed.)
84
+
* At least one client-facing IP address. (All client-facing addresses are managed by the cluster's *vserver*, which can move the IP addresses among nodes as needed.)
85
85
* One IP address for cluster communication
86
86
* One instance IP address (assigned to the VM)
87
87
@@ -104,21 +104,19 @@ Each vFXT node will be identical. That is, if you create a three-node cluster yo
104
104
105
105
Disk cache per node is configurable and can rage from 1000 GB to 8000 GB. 4 TB per node is the recommended cache size for Standard_E32s_v3 nodes.
106
106
107
-
For additional information about these VMs, read the Microsoft Azure documentation:
For additional information about these VMs, read the Microsoft Azure documentation: [Memory optimized virtual machine sizes](https://docs.microsoft.com/azure/virtual-machines/windows/sizes-memory)
110
108
111
109
## Account quota
112
110
113
111
Make sure that your subscription has the capacity to run the Avere vFXT cluster as well as any computing or client systems being used. Read [Quota for the vFXT cluster](avere-vfxt-prereqs.md#quota-for-the-vfxt-cluster) for details.
114
112
115
113
## Back-end data storage
116
114
117
-
Back-end storage systems both supply files to the cluster's cache and also receive changed data from the cache. Decide whether your working set will be stored long term in a new Blob container or in an existing cloud or hardware storage system. These back-end storage systems are called *core filers*.
115
+
Back-end storage systems both supply files to the cluster's cache and also receive changed data from the cache. Decide whether your working set will be stored long term in a new Blob container or in an existing storage system (cloud or hardware). These back-end storage systems are called *core filers*.
118
116
119
117
### Hardware core filers
120
118
121
-
Add hardware storage systems to the vFXT cluster after you create the cluster. You can use any existing on-premises hardware system, including on-premises systems, as long as the storage system can be reached from the cluster's subnet.
119
+
Add hardware storage systems to the vFXT cluster after you create the cluster. You can use a variety of popular hardware systems, including on-premises systems, as long as the storage system can be reached from the cluster's subnet.
122
120
123
121
Read [Configure storage](avere-vfxt-add-storage.md) for detailed instructions about how to add an existing storage system to the Avere vFXT cluster.
124
122
@@ -144,7 +142,7 @@ Access options include:
144
142
> [!TIP]
145
143
> If you set a public IP address on the cluster controller, you can use it as the jump host. Read [Cluster controller as jump host](#cluster-controller-as-jump-host) for more information.
146
144
147
-
* Virtual private network (VPN) - Configure a point-to-site or site-to-site VPN to your private network.
145
+
* Virtual private network (VPN) - Configure a point-to-site or site-to-site VPN between your private network in Azure and corporate networks.
148
146
149
147
* Azure ExpressRoute - Configure a private connection through an ExpressRoute partner.
150
148
@@ -158,20 +156,20 @@ To improve security for a controller with a public IP address, the deployment sc
158
156
159
157
When creating the cluster, you can choose whether or not to create a public IP address on the cluster controller.
160
158
161
-
* If you create a **new virtual network** or a **new subnet**, the cluster controller will be assigned a **public IP address**.
159
+
* If you create a **new virtual network** or a **new subnet**, the cluster controller will be assigned a **public** IP address.
162
160
* If you select an existing virtual network and subnet, the cluster controller will have only **private** IP addresses.
163
161
164
162
## VM access roles
165
163
166
164
Azure uses [role-based access control](../role-based-access-control/index.yml) (RBAC) to authorize the cluster VMs to perform certain tasks. For example, the cluster controller needs authorization to create and configure the cluster node VMs. Cluster nodes need to be able to assign or reassign IP addresses to other cluster nodes.
167
165
168
-
Two built-in Azure roles are used for the Avere vFXT for Azure virtual machines:
166
+
Two built-in Azure roles are used for the Avere vFXT virtual machines:
169
167
170
168
* The cluster controller uses the built-in role [Avere Contributor](../role-based-access-control/built-in-roles.md#avere-contributor).
171
-
* Cluster nodes use the built-in role [Avere Operator](../role-based-access-control/built-in-roles.md#avere-operator)
169
+
* Cluster nodes use the built-in role [Avere Operator](../role-based-access-control/built-in-roles.md#avere-operator).
172
170
173
171
If you need to customize access roles for Avere vFXT components, you must define your own role and then assign it to the VMs at the time they are created. You cannot use the deployment template in the Azure Marketplace. Consult Microsoft Customer Service and Support by opening a ticket in the Azure portal as described in [Get help with your system](avere-vfxt-open-ticket.md).
174
172
175
173
## Next step: Understand the deployment process
176
174
177
-
[Deployment overview](avere-vfxt-deploy-overview.md) gives the bigpicture view of the steps needed to create an Avere vFXT for Azure system and get it ready to serve data.
175
+
[Deployment overview](avere-vfxt-deploy-overview.md) gives the big-picture view of the steps needed to create an Avere vFXT for Azure system and get it ready to serve data.
Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-deploy.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Steps to deploy the Avere vFXT cluster in Azure
4
4
author: ekpgh
5
5
ms.service: avere-vfxt
6
6
ms.topic: conceptual
7
-
ms.date: 12/14/2019
7
+
ms.date: 01/13/2020
8
8
ms.author: rohogue
9
9
---
10
10
@@ -17,7 +17,7 @@ This procedure walks you through using the deployment wizard available from the
17
17
* Creates the cluster node VMs and configures them as the Avere cluster.
18
18
* If requested, creates a new Azure Blob container and configures it as a cluster core filer.
19
19
20
-
After following the instructions in this document, you will have a virtual network, a subnet, a controller, and a vFXT cluster as shown in the following diagram. This diagram shows the optional Azure Blob core filer, which includes a new Blob storage container (in a new storage account, not shown) and a service endpoint for Microsoft storage inside the subnet.
20
+
After following the instructions in this document, you will have a virtual network, a subnet, a cluster controller, and a vFXT cluster as shown in the following diagram. This diagram shows the optional Azure Blob core filer, which includes a new Blob storage container (in a new storage account, not shown) and a service endpoint for Microsoft storage inside the subnet.
21
21
22
22

23
23
@@ -26,7 +26,7 @@ Before using the creation template, make sure you have addressed these prerequis
1.[Quota for the vFXT cluster](avere-vfxt-prereqs.md#quota-for-the-vfxt-cluster)
29
-
1.[Storage service endpoint (if needed)](avere-vfxt-prereqs.md#create-a-storage-service-endpoint-in-your-virtual-network-if-needed) - Required for deploys using an existing virtual network and creating blob storage
29
+
1.[Storage service endpoint (if needed)](avere-vfxt-prereqs.md#create-a-storage-service-endpoint-in-your-virtual-network-if-needed) - Required for deployments that use an existing virtual network and create blob storage
30
30
31
31
For more information about cluster deployment steps and planning, read [Plan your Avere vFXT system](avere-vfxt-deploy-plan.md) and [Deployment overview](avere-vfxt-deploy-overview.md).
32
32
@@ -36,7 +36,7 @@ Access the creation template in the Azure portal by searching for Avere and sele
36
36
37
37

38
38
39
-
After reading the details on the Avere vFXT for Azure ARM Template page, click **Create** to begin.
39
+
After reading the details on the Avere vFXT for Azure ARM Template page, click its **Create** button to begin.
40
40
41
41

Copy file name to clipboardExpand all lines: articles/avere-vfxt/avere-vfxt-manage-cluster.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: How to manage Avere cluster - add or remove nodes, reboot, stop, or
4
4
author: ekpgh
5
5
ms.service: avere-vfxt
6
6
ms.topic: conceptual
7
-
ms.date: 12/19/2019
7
+
ms.date: 01/13/2020
8
8
ms.author: rohogue
9
9
---
10
10
@@ -47,7 +47,7 @@ The Avere Control Panel can be used for these tasks:
47
47
* Remove a node from the cluster
48
48
* Stop or reboot the entire cluster
49
49
50
-
Avere Control Panel prioritizes data integrity, so it attempts to write any changed data to backend storage before a possibly destructive operation. This makes it a safer option than the Azure portal.
50
+
Avere Control Panel prioritizes data integrity, so it attempts to write any changed data to back-end storage before a possibly destructive operation. This makes it a safer option than the Azure portal.
51
51
52
52
Access Avere Control Panel from a web browser. Follow the instructions in [Access the vFXT cluster](avere-vfxt-cluster-gui.md) if you need help.
0 commit comments