Skip to content

Commit 150b526

Browse files
Enrico Usaisean-smith
authored andcommitted
doc: add "Moving from CfnCluster to AWS ParallelCluster" section
Signed-off-by: Enrico Usai <[email protected]>
1 parent 352a8c2 commit 150b526

File tree

2 files changed

+86
-11
lines changed

2 files changed

+86
-11
lines changed

docs/source/getting_started.rst

Lines changed: 85 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -16,13 +16,14 @@ You can build higher level workflows, such as a Genomics portal that automates t
1616
Installing AWS ParallelCluster
1717
==============================
1818

19-
The current working version is aws-parallelcluster-|version|. The CLI is written in Python and uses BOTO for AWS actions. You can install the CLI with the following commands, depending on your OS.
19+
The current working version is aws-parallelcluster-|version|. The CLI is written in Python and uses BOTO for AWS actions.
20+
You can install the CLI with the following commands, depending on your OS.
2021

2122
Linux/OSX
2223
---------
2324
::
2425

25-
$ sudo pip install aws-parallelcluster
26+
$ sudo pip install aws-parallelcluster
2627

2728
Windows
2829
-------
@@ -39,7 +40,7 @@ Now it should be possible to run the following within a command prompt window:
3940

4041
::
4142

42-
C:\> pip install aws-parallelcluster
43+
C:\> pip install aws-parallelcluster
4344

4445
Upgrading
4546
---------
@@ -61,20 +62,22 @@ Once installed you will need to setup some initial config. The easiest way to do
6162

6263
$ pcluster configure
6364

64-
This configure wizard will prompt you for everything you need to create your cluster. You will first be prompted for your cluster template name, which is the logical name of the template you will create a cluster from.
65+
This configure wizard will prompt you for everything you need to create your cluster.
66+
You will first be prompted for your cluster template name, which is the logical name of the template you will create a cluster from.
6567

6668
::
6769

6870
Cluster Template [mycluster]:
6971

70-
Next, you will be prompted for your AWS Access & Secret Keys. Enter the keys for an IAM user with administrative privileges. These can also be read from your environment variables or the aws CLI config.
72+
Next, you will be prompted for your AWS Access & Secret Keys. Enter the keys for an IAM user with administrative privileges.
73+
These can also be read from your environment variables or the aws CLI config.
7174

7275
::
7376

7477
AWS Access Key ID []:
7578
AWS Secret Access Key ID []:
7679

77-
Now, you will be presented with a list of valid AWS region identifiers. Choose the region in which you'd like your cluster to run.
80+
Now, you will be presented with a list of valid AWS region identifiers. Choose the region in which you'd like your cluster to run.
7881

7982
::
8083

@@ -98,7 +101,8 @@ Choose a descriptive name for your VPC. Typically, this will something like :cod
98101

99102
VPC Name [myvpc]:
100103

101-
Next, you will need to choose a keypair that already exists in EC2 in order to log into your master instance. If you do not already have a keypair, refer to the EC2 documentation on `EC2 Key Pairs <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-key-pairs.html>`_.
104+
Next, you will need to choose a keypair that already exists in EC2 in order to log into your master instance.
105+
If you do not already have a keypair, refer to the EC2 documentation on `EC2 Key Pairs <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-key-pairs.html>`_.
102106

103107
::
104108

@@ -128,12 +132,83 @@ Finally, choose the subnet in which you'd like your master server to run in.
128132
Master Subnet ID []:
129133

130134

131-
Next, a simple cluster launches into a VPC and uses an existing subnet which supports public IP's i.e. the route table for the subnet is :code:`0.0.0.0/0 => igw-xxxxxx`. The VPC must have :code:`DNS Resolution = yes` and :code:`DNS Hostnames = yes`. It should also have DHCP options with the correct :code:`domain-name` for the region, as defined in the docs: `VPC DHCP Options <http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_DHCP_Options.html>`_.
135+
Next, a simple cluster launches into a VPC and uses an existing subnet which supports public IP's i.e. the route table for the subnet is :code:`0.0.0.0/0 => igw-xxxxxx`.
136+
The VPC must have :code:`DNS Resolution = yes` and :code:`DNS Hostnames = yes`.
137+
It should also have DHCP options with the correct :code:`domain-name` for the region, as defined in the docs: `VPC DHCP Options <http://docs.aws.amazon.com/AmazonVPC/latest/UserGuide/VPC_DHCP_Options.html>`_.
132138

133139
Once all of those settings contain valid values, you can launch the cluster by running the create command:
134140

135141
::
136142

137-
$ pcluster create mycluster
143+
$ pcluster create mycluster
144+
145+
Once the cluster reaches the "CREATE_COMPLETE" status, you can connect using your normal SSH client/settings.
146+
For more details on connecting to EC2 instances, check the `EC2 User Guide <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-connect-to-instance-linux.html#using-ssh-client>`_.
147+
148+
149+
Moving from CfnCluster to AWS ParallelCluster
150+
=============================================
151+
152+
AWS ParallelCluster is an enhanced and productized version of CfnCluster.
153+
154+
If you are a previous CfnCluster's user, we encourage you to start using and creating new clusters only with AWS ParallelCluster.
155+
Although you can still use CfnCluster, it will no longer be developed.
156+
157+
The main differences between CfnCluster and AWS ParallelCluster are listed below.
158+
159+
|
160+
161+
**AWS ParallelCluster CLI manages a different set of clusters**
162+
163+
Clusters created by :code:`cfncluster` CLI cannot be managed with :code:`pcluster` CLI.
164+
The following commands will no longer work on clusters created by CfnCluster::
165+
166+
pcluster list
167+
pcluster update cluster_name
168+
pcluster start cluster_name
169+
pcluster status cluster_name
170+
171+
You need to use the :code:`cfncluster` CLI to manage your old clusters.
172+
173+
If you need an old CfnCluster package to manage your old clusters, we recommend to install and use it
174+
from a `Python Virtual Environment <https://docs.python.org/3/tutorial/venv.html>`_.
175+
176+
|
177+
178+
**Distinct IAM Custom Policies**
179+
180+
Custom IAM Policies, previously used for CfnCluster cluster creation, cannot be used with AWS ParallelCluster.
181+
If you require custom policies you need to create the new ones by following :ref:`IAM in AWS ParallelCluster <iam>` guide.
182+
183+
|
184+
185+
**Different configuration files**
186+
187+
The AWS ParallelCluster configuration file resides in the :code:`~/.parallelcluster` folder, unlike the CfnCluster one that was created in the :code:`~/.cfncluster` folder.
188+
189+
You can still use your existing configuration file but this needs to be moved from :code:`~/.cfncluster/config` to :code:`~/.parallelcluster/config`.
190+
191+
If you use the :code:`extra_json` configuration parameter, it has be changed as described below:
192+
193+
:code:`extra_json = { "cfncluster" : { } }`
194+
195+
has been changed to
196+
197+
:code:`extra_json = { "cluster" : { } }`
198+
199+
|
200+
201+
**Ganglia disabled by default**
202+
203+
Ganglia is disabled by default.
204+
You can enable it by setting the :code:`extra_json` parameter as described below:
205+
206+
:code:`extra_json = { "cluster" : { ganglia_enabled = 'yes' } }`
207+
208+
and changing the Master SG to allow connections to port 80.
209+
The :code:`parallelcluster-<CLUSTER_NAME>-MasterSecurityGroup-<xxx>` Security Group has to be modified by
210+
`adding a new Security Group Rule <https://docs.aws.amazon.com/en_us/AWSEC2/latest/UserGuide/using-network-security.html#adding-security-group-rule>`_
211+
to allow Inbound connection to the port 80 from your Public IP.
212+
213+
138214

139-
Once the cluster reaches the "CREATE_COMPLETE" status, you can connect using your normal SSH client/settings. For more details on connecting to EC2 instances, check the `EC2 User Guide <http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-connect-to-instance-linux.html#using-ssh-client>`_.

docs/source/iam.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -316,7 +316,7 @@ ParallelClusterUserPolicy
316316
"iam:SimulatePrincipalPolicy"
317317
],
318318
"Effect": "Allow",
319-
"Resource": "arn:aws:iam::<AWS ACCOUNT ID>:role/<CFNCLUSTER EC2 ROLE NAME>"
319+
"Resource": "arn:aws:iam::<AWS ACCOUNT ID>:role/<PARALLELCLUSTER EC2 ROLE NAME>"
320320
},
321321
{
322322
"Sid": "IAMCreateInstanceProfile",

0 commit comments

Comments
 (0)