Skip to content

Commit d19e521

Browse files
committed
Adding GCE to executor docs
1 parent ad06b4b commit d19e521

File tree

2 files changed

+12
-0
lines changed

2 files changed

+12
-0
lines changed

docs/userguide/execution.rst

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,9 @@ Parsl currently supports the following executors:
8787
4. `parsl.executors.taskvine.TaskVineExecutor`: This executor uses `TaskVine <https://ccl.cse.nd.edu/software/taskvine/>`_ as the execution backend. TaskVine scales up to tens of thousands of cores and actively uses local storage on compute nodes to offer a diverse array of performance-oriented features, including: smart caching and sharing common large files between tasks and compute nodes, reliable execution of tasks, dynamic resource sizing, automatic Python environment detection and sharing.
8888
These executors cover a broad range of execution requirements. As with other Parsl components, there is a standard interface (ParslExecutor) that can be implemented to add support for other executors.
8989

90+
5. `parsl.executors.globus_compute.GlobusComputeExecutor`: This executor uses `Globus Compute <https://globus-compute.readthedocs.io/en/latest/index.html>`_
91+
as the execution backend to run functions on remote systems.
92+
9093
.. note::
9194
Refer to :ref:`configuration-section` for information on how to configure these executors.
9295

parsl/executors/globus_compute.py

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,15 @@ class GlobusComputeExecutor(ParslExecutor, RepresentationMixin):
2424
Refer to `globus-compute user documentation <https://globus-compute.readthedocs.io/en/latest/executor.html>`_
2525
and `reference documentation <https://globus-compute.readthedocs.io/en/latest/reference/executor.html>`_
2626
for more details.
27+
28+
.. note::
29+
As a remote execution system, Globus Compute relies on serialization to ship
30+
tasks and results between the Parsl client side and the remote Globus Compute
31+
Endpoint side. Serialization is unreliable across python versions, and
32+
wrappers used by Parsl assume identical Parsl versions across on both sides.
33+
We recommend using matching Python, Parsl and Globus Compute version on both
34+
the client side and the endpoint side for stable behavior.
35+
2736
"""
2837

2938
def __init__(

0 commit comments

Comments
 (0)