Skip to content

Commit a9b9587

Browse files
datamelwxtim
andauthored
Install Target and Platform Update (#534)
* Install Target and Platform Update * Rewrite platform configs * Update installation section * DM Review Feedback * Further changes to platform examples * Response to review Co-authored-by: Tim Pillinger <[email protected]>
1 parent 7382fe2 commit a9b9587

File tree

9 files changed

+245
-224
lines changed

9 files changed

+245
-224
lines changed

src/7-to-8/caveats.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,7 @@ Multiple Selection
5858
* https://github.com/cylc/cylc-ui/issues/434
5959
Installing Workflows
6060
At present there is no way to view or install
61-
:term:`source workflows <source directory>`) in the UI.
61+
:term:`source workflows <source directory>` in the UI.
6262
Rose Edit
6363
Rose Edit is awaiting reimplementation in the UI.
6464
Trigger Edit

src/7-to-8/major-changes/cylc-install.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@ Remote Installation
8989

9090
Remote file installation does not occur until running the workflow.
9191
When the first task runs on a remote platform, Cylc will transfer files from
92-
the :term:`run directory` to the install target.
92+
the :term:`run directory` to the :term:`install target`.
9393

9494
If you have used Rose 2019, you may be used to all files and directories in
9595
the run directory being included.

src/7-to-8/major-changes/platforms.rst

Lines changed: 18 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -31,8 +31,9 @@ In Cylc 8 "platforms" can be defined in the global configuration
3131
(:cylc:conf:`global.cylc`) so that this configuration doesn't have to be
3232
repeated for each task in each workflow.
3333

34-
Cylc "platforms" may configure hostnames, job runners and more. Only the
35-
platform name needs to be specified in the task configuration.
34+
There may be cases where sets of platforms (for example a group of
35+
standalone compute servers, or a pair of mirrored HPC's) might be equally
36+
suitable for a task. Such platforms can be set up to be ``platform groups``
3637

3738
.. seealso::
3839

@@ -167,7 +168,7 @@ At Cylc 8 the equivalent might be:
167168
168169
[[mytask_login_to_hpc_and_submit]]
169170
# Recommended:
170-
platform = just_run_it
171+
platform = slurm_supercomputer
171172
# ...but This is still legal:
172173
#platform = $(selector-script)
173174
@@ -183,13 +184,25 @@ And the platform settings for these examples might be:
183184
# A computer with PBS, that takes local job submissions
184185
job runner = pbs
185186
hosts = localhost
187+
install target = localhost
186188
187189
[[slurm_supercomputer]]
188190
# This computer with Slurm requires you to use a login node.
189191
hosts = login_node01, login_node02 # Cylc will pick a host.
190192
job runner = slurm
191193
192194
195+
Note that in these examples, it is assumed that ``linuxboxNN``, ``pbs_local`` and
196+
``slurm_supercomputer`` have distinct file systems.
197+
Sets of platforms which share a file system must specify
198+
a single :ref:`install target <Install Targets>`.
199+
200+
.. note::
201+
If an install target is not set, a platform will use its own platform name
202+
as the install target name. If multiple platforms share a file system
203+
but have separate :ref:`install targets <Install Targets>` task initialization
204+
will fail.
205+
193206
.. _host-to-platform-logic:
194207

195208
How Cylc 8 handles host-to-platform upgrades
@@ -216,6 +229,7 @@ platforms section:
216229
[[supercomputer_A]]
217230
hosts = localhost
218231
job runner = slurm
232+
install target = localhost
219233
[[supercomputer_B]]
220234
hosts = tigger, wol, eeyore
221235
job runner = pbs
@@ -230,7 +244,7 @@ And you have a workflow runtime configuration:
230244
batch system = slurm
231245
[[task2]]
232246
[[[remote]]]
233-
hosts = eeyore
247+
host = eeyore
234248
[[[job]]]
235249
batch system = pbs
236250

src/glossary.rst

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1051,6 +1051,14 @@ Glossary
10511051

10521052
* :term:`reinstall`
10531053

1054+
install target
1055+
Cylc uses install targets to determine which platforms share file systems.
1056+
Install targets should normally be managed at site level. They are configured in
1057+
:cylc:conf:`global.cylc[platforms][<platform name>]install target`.
1058+
1059+
.. seealso::
1060+
1061+
* :ref:`Install Targets`
10541062

10551063
reinstall
10561064
reinstallation

src/installation.rst

Lines changed: 19 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -237,12 +237,13 @@ To do so create a symbolic link to the wrapper, for each of these commands:
237237
Configuration
238238
-------------
239239

240-
Cylc uses "sane and safe" defaults and is suitable for use "out of the box".
240+
Cylc uses sane and safe defaults and is suitable for use "out of the box",
241+
if all you need to do is run jobs locally in the background.
241242
However, many things may need to be configured, e.g:
242243

243-
* Job hosts
244-
* Communication methods
245-
* User/Site preferences
244+
* :ref:`AdminGuide.PlatformConfigs` (jobs hosts, runners, etc)
245+
* :ref:`Scheduler Hosts<Submitting Workflows To a Pool Of Hosts>`
246+
* :ref:`Default Event Handlers<EventHandlers>`
246247

247248
Cylc Flow
248249
^^^^^^^^^
@@ -255,6 +256,20 @@ configuration of the system on both a site and user basis.
255256
Prior to Cylc 8, ``global.cylc`` was named ``global.rc``, but that name is
256257
no longer supported.
257258

259+
The global.cylc file should be available on user machines (where users interact
260+
with Cylc on the command line) and on cylc servers (where Cylc schedulers run).
261+
It is not required to be available on job hosts.
262+
263+
More information about supported configuration items and defaults can be found:
264+
:ref:`global-configuration`.
265+
266+
Cylc UI Server
267+
^^^^^^^^^^^^^^
268+
The `Cylc UI Server`_ can be configured on a site and user basis.
269+
Guidance for configuration file storage, configuration variables and defaults
270+
can be found: :ref:`UI_Server_config`.
271+
272+
258273
Bash Profile
259274
^^^^^^^^^^^^
260275

0 commit comments

Comments
 (0)