Skip to content

Commit 39b006f

Browse files
authored
Update README.md (#117)
Added a few lines about SPMD
1 parent 5acaf70 commit 39b006f

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

README.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -266,8 +266,9 @@ on the ith worker that `d` is distributed over.
266266

267267
SPMD Mode (An MPI Style SPMD mode with MPI like primitives)
268268
------------------------------------------------------------
269+
SPMD, i.e., a Single Program Multiple Data mode is implemented by submodule `DistributedArrays.SPMD`. In this mode the same function is executed in parallel on all participating nodes. This is a typical style of MPI programs where the same program is executed on all processors. A basic subset of MPI-like primitives are currently supported. As a programming model it should be familiar to folks with an MPI background.
269270

270-
We can easily run the same block of code on all workers in an SPMD mode using the `spmd` function.
271+
The same block of code is executed concurrently on all workers using the `spmd` function.
271272

272273
```
273274
# define foo() on all workers
@@ -373,7 +374,7 @@ key-value pairs between spmd runs under the same context.
373374

374375
NOTE: Implicitly defined contexts, i.e., `spmd` calls without specifying a `context` create a context
375376
which live only for the duration of the call. Explictly created context objects can be released
376-
early by calling `close(stxt::SPMDContext)`. This will release the local storage dictionaries
377+
early by calling `close(ctxt::SPMDContext)`. This will release the local storage dictionaries
377378
on all participating `pids`. Else they will be released when the context object is gc'ed
378379
on the node that created it.
379380

0 commit comments

Comments
 (0)