Documentation: parallel builds with flang + Caffeine

[rouson]

This PR includes the commit(s) from PR #234. The current PR edits the README.md file to include instructions for parallel runs of neural-fortran with the LLVM flang-new compiler and the Caffeine parallel runtime library.

[rouson]

On macOS with Caffeine and its GASNet prerequisite installed in .local/lib, the command below launches the neural-fortran test suite with two executing images and it appears that 2 of 27 tests fail so I'm marking this PR as "Draft". The two failure messages are incorrect updated weights.. failedandtest_linear2d_layer: One or more tests failed.`, each of which prints twice -- presumably indicating failure on both images.

GASNET_PSHM_NODES=2 \
  fpm test \ 
  --compiler flang-new \
  --flag "-O3 -fcoarray -DPARALLEL" \
  --link-flag "-lcaffeine -lgasnet-smp-seq -L~/.local/lib"
Project is up to date
test_dense_layer: All tests passed.
test_dense_layer: All tests passed.
test_optimizers: All tests passed.
test_optimizers: All tests passed.
test_multihead_attention_layer: All tests passed.
test_multihead_attention_layer: All tests passed.
test_input1d_layer: All tests passed.
test_input1d_layer: All tests passed.
test_parametric_activation: All tests passed.
test_parametric_activation: All tests passed.
test_conv2d_layer: All tests passed.
test_conv2d_layer: All tests passed.
test_maxpool2d_layer: All tests passed.
test_maxpool2d_layer: All tests passed.
test_dropout_layer: All tests passed.
test_dropout_layer: All tests passed.
test_input3d_layer: All tests passed.
test_input3d_layer: All tests passed.
test_flatten_layer: All tests passed.
test_flatten_layer: All tests passed.
test_reshape_layer: All tests passed.
test_reshape_layer: All tests passed.
test_conv2d_network: All tests passed.
test_conv2d_network: All tests passed.
test_reshape2d_layer: All tests passed.
test_reshape2d_layer: All tests passed.
test_metrics: All tests passed.
test_metrics: All tests passed.
test_loss: All tests passed.
test_loss: All tests passed.
incorrect updated weights.. failed
incorrect updated weights.. failed
test_linear2d_layer: One or more tests failed.
test_linear2d_layer: One or more tests failed.
Fortran STOPFortran STOP: code 1
: code 1


IEEE arithmetic exceptions signaled:IEEE arithmetic exceptions signaled: INEXACT INEXACT

test_conv1d_network: All tests passed.
test_conv1d_network: All tests passed.
test_layernorm_layer: All tests passed.
test_layernorm_layer: All tests passed.
test_locally_connected2d_layer: All tests passed.
test_locally_connected2d_layer: All tests passed.
test_get_set_network_params: All tests passed.
test_get_set_network_params: All tests passed.
test_embedding_layer: All tests passed.
test_embedding_layer: All tests passed.
test_conv1d_layer: All tests passed.
test_conv1d_layer: All tests passed.
test_maxpool1d_layer: All tests passed.
test_maxpool1d_layer: All tests passed.
test_dense_network: All tests passed.
test_dense_network: All tests passed.
test_insert_flatten: All tests passed.
test_insert_flatten: All tests passed.
test_input2d_layer: All tests passed.
test_input2d_layer: All tests passed.

[milancurcic]

We can look into it but my bet is it's nothing to do with parallel stuff; the test itself may be not portable to flang, it came in after I played with flang last.

[rouson]

@milancurcic correct: a single-image run fails with flang/Caffeine so I agree it's a porting issue.

[milancurcic]

Did you mean to put this here? It seems out of context