You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/getting_started.rst
+85-10Lines changed: 85 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,13 +16,14 @@ You can build higher level workflows, such as a Genomics portal that automates t
16
16
Installing AWS ParallelCluster
17
17
==============================
18
18
19
-
The current working version is aws-parallelcluster-|version|. The CLI is written in Python and uses BOTO for AWS actions. You can install the CLI with the following commands, depending on your OS.
19
+
The current working version is aws-parallelcluster-|version|. The CLI is written in Python and uses BOTO for AWS actions.
20
+
You can install the CLI with the following commands, depending on your OS.
20
21
21
22
Linux/OSX
22
23
---------
23
24
::
24
25
25
-
$ sudo pip install aws-parallelcluster
26
+
$ sudo pip install aws-parallelcluster
26
27
27
28
Windows
28
29
-------
@@ -39,7 +40,7 @@ Now it should be possible to run the following within a command prompt window:
39
40
40
41
::
41
42
42
-
C:\> pip install aws-parallelcluster
43
+
C:\> pip install aws-parallelcluster
43
44
44
45
Upgrading
45
46
---------
@@ -61,20 +62,22 @@ Once installed you will need to setup some initial config. The easiest way to do
61
62
62
63
$ pcluster configure
63
64
64
-
This configure wizard will prompt you for everything you need to create your cluster. You will first be prompted for your cluster template name, which is the logical name of the template you will create a cluster from.
65
+
This configure wizard will prompt you for everything you need to create your cluster.
66
+
You will first be prompted for your cluster template name, which is the logical name of the template you will create a cluster from.
65
67
66
68
::
67
69
68
70
Cluster Template [mycluster]:
69
71
70
-
Next, you will be prompted for your AWS Access & Secret Keys. Enter the keys for an IAM user with administrative privileges. These can also be read from your environment variables or the aws CLI config.
72
+
Next, you will be prompted for your AWS Access & Secret Keys. Enter the keys for an IAM user with administrative privileges.
73
+
These can also be read from your environment variables or the aws CLI config.
71
74
72
75
::
73
76
74
77
AWS Access Key ID []:
75
78
AWS Secret Access Key ID []:
76
79
77
-
Now, you will be presented with a list of valid AWS region identifiers. Choose the region in which you'd like your cluster to run.
80
+
Now, you will be presented with a list of valid AWS region identifiers. Choose the region in which you'd like your cluster to run.
78
81
79
82
::
80
83
@@ -98,7 +101,8 @@ Choose a descriptive name for your VPC. Typically, this will something like :cod
98
101
99
102
VPC Name [myvpc]:
100
103
101
-
Next, you will need to choose a keypair that already exists in EC2 in order to log into your master instance. If you do not already have a keypair, refer to the EC2 documentation on `EC2 Key Pairs <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-key-pairs.html>`_.
104
+
Next, you will need to choose a keypair that already exists in EC2 in order to log into your master instance.
105
+
If you do not already have a keypair, refer to the EC2 documentation on `EC2 Key Pairs <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-key-pairs.html>`_.
102
106
103
107
::
104
108
@@ -128,12 +132,83 @@ Finally, choose the subnet in which you'd like your master server to run in.
128
132
Master Subnet ID []:
129
133
130
134
131
-
Next, a simple cluster launches into a VPC and uses an existing subnet which supports public IP's i.e. the route table for the subnet is :code:`0.0.0.0/0 => igw-xxxxxx`. The VPC must have :code:`DNS Resolution = yes` and :code:`DNS Hostnames = yes`. It should also have DHCP options with the correct :code:`domain-name` for the region, as defined in the docs: `VPC DHCP Options <http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_DHCP_Options.html>`_.
135
+
Next, a simple cluster launches into a VPC and uses an existing subnet which supports public IP's i.e. the route table for the subnet is :code:`0.0.0.0/0 => igw-xxxxxx`.
136
+
The VPC must have :code:`DNS Resolution = yes` and :code:`DNS Hostnames = yes`.
137
+
It should also have DHCP options with the correct :code:`domain-name` for the region, as defined in the docs: `VPC DHCP Options <http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_DHCP_Options.html>`_.
132
138
133
139
Once all of those settings contain valid values, you can launch the cluster by running the create command:
134
140
135
141
::
136
142
137
-
$ pcluster create mycluster
143
+
$ pcluster create mycluster
144
+
145
+
Once the cluster reaches the "CREATE_COMPLETE" status, you can connect using your normal SSH client/settings.
146
+
For more details on connecting to EC2 instances, check the `EC2 User Guide <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-connect-to-instance-linux.html#using-ssh-client>`_.
147
+
148
+
149
+
Moving from CfnCluster to AWS ParallelCluster
150
+
=============================================
151
+
152
+
AWS ParallelCluster is an enhanced and productized version of CfnCluster.
153
+
154
+
If you are a previous CfnCluster's user, we encourage you to start using and creating new clusters only with AWS ParallelCluster.
155
+
Although you can still use CfnCluster, it will no longer be developed.
156
+
157
+
The main differences between CfnCluster and AWS ParallelCluster are listed below.
158
+
159
+
|
160
+
161
+
**AWS ParallelCluster CLI manages a different set of clusters**
162
+
163
+
Clusters created by :code:`cfncluster` CLI cannot be managed with :code:`pcluster` CLI.
164
+
The following commands will no longer work on clusters created by CfnCluster::
165
+
166
+
pcluster list
167
+
pcluster update cluster_name
168
+
pcluster start cluster_name
169
+
pcluster status cluster_name
170
+
171
+
You need to use the :code:`cfncluster` CLI to manage your old clusters.
172
+
173
+
If you need an old CfnCluster package to manage your old clusters, we recommend to install and use it
174
+
from a `Python Virtual Environment <https://docs.python.org/3/tutorial/venv.html>`_.
175
+
176
+
|
177
+
178
+
**Distinct IAM Custom Policies**
179
+
180
+
Custom IAM Policies, previously used for CfnCluster cluster creation, cannot be used with AWS ParallelCluster.
181
+
If you require custom policies you need to create the new ones by following :ref:`IAM in AWS ParallelCluster <iam>` guide.
182
+
183
+
|
184
+
185
+
**Different configuration files**
186
+
187
+
The AWS ParallelCluster configuration file resides in the :code:`~/.parallelcluster` folder, unlike the CfnCluster one that was created in the :code:`~/.cfncluster` folder.
188
+
189
+
You can still use your existing configuration file but this needs to be moved from :code:`~/.cfncluster/config` to :code:`~/.parallelcluster/config`.
190
+
191
+
If you use the :code:`extra_json` configuration parameter, it has be changed as described below:
192
+
193
+
:code:`extra_json = { "cfncluster" : { } }`
194
+
195
+
has been changed to
196
+
197
+
:code:`extra_json = { "cluster" : { } }`
198
+
199
+
|
200
+
201
+
**Ganglia disabled by default**
202
+
203
+
Ganglia is disabled by default.
204
+
You can enable it by setting the :code:`extra_json` parameter as described below:
and changing the Master SG to allow connections to port 80.
209
+
The :code:`parallelcluster-<CLUSTER_NAME>-MasterSecurityGroup-<xxx>` Security Group has to be modified by
210
+
`adding a new Security Group Rule <https://docs.aws.amazon.com/en_us/AWSEC2/latest/UserGuide/using-network-security.html#adding-security-group-rule>`_
211
+
to allow Inbound connection to the port 80 from your Public IP.
212
+
213
+
138
214
139
-
Once the cluster reaches the "CREATE_COMPLETE" status, you can connect using your normal SSH client/settings. For more details on connecting to EC2 instances, check the `EC2 User Guide <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-connect-to-instance-linux.html#using-ssh-client>`_.
0 commit comments