Skip to content

Establish pipeline#8

Open
radistoubalidis wants to merge 8 commits intomoja-global:masterfrom
radistoubalidis:add_pipeline
Open

Establish pipeline#8
radistoubalidis wants to merge 8 commits intomoja-global:masterfrom
radistoubalidis:add_pipeline

Conversation

@radistoubalidis
Copy link

@radistoubalidis radistoubalidis commented Aug 1, 2022

Add dvc pipeline to Colombia Case

Description

The goal of this PR is :

  • create a dvc pipeline containing the stages as described in Standalone_GCBM\readme.txt
  • establish an action that when someone pushes a new run from a new branch is uses dvc to publish differences between the post-processing plots or other parameters.

Similar to GCBM.Belize

Type of change

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Additional Context (Please include any Screenshots/gifs if relevant)

Follow the dvc installation and pipeline execution guide in pipeline.md to run the pipeline locally.

output of dvc stage list

tiler                       Outputs ..\..\logs\tiler_log.txt
recliner2gcbm_x64           Outputs logs\recliner_log.txt
add_species_vol_to_bio      Outputs logs\add_species_vol_to_bio.log
modify_root_parameters      Outputs logs\modify_root_parameters.log
modify_decay_parameters     Outputs logs\modify_decay_parameters.log
modify_turnover_parameters  Outputs logs\modify_turnover_parameters.log
modify_spinup_parameters    Outputs logs\modify_spinup_parameters.log
update_gcbm_configuration   Outputs ..\logs\update_gcbm_config.log
run_gcbm                    Outputs ..\logs\Moja_Debug.log
create_tiffs                Outputs ..\..\logs\create_tiffs.log, ..\..\processed_output\spatial
compile_results             Outputs ..\..\logs\compile_results.log
postprocessing              Reports metrics, Figures/Colombia_Sensitivity_TropicalDry.png, Figures/Colombia

@radistoubalidis radistoubalidis marked this pull request as draft August 1, 2022 13:17
@radistoubalidis radistoubalidis changed the title adds postprocessing directory Establish pipeline Aug 3, 2022
@radistoubalidis radistoubalidis marked this pull request as ready for review August 3, 2022 12:28
@radistoubalidis
Copy link
Author

Pipeline's flowchart

flowchart TD
        node1[add_species_vol_to_bio]
        node2[compile_results]
        node3[create_tiffs]
        node4[modify_decay_parameters]
        node5[modify_root_parameters]
        node6[modify_spinup_parameters]
        node7[modify_turnover_parameters]
        node8[postprocessing]
        node9[recliner2gcbm_x64]
        node10[run_gcbm]
        node11[tiler]
        node12[update_gcbm_configuration]
        node1-->node5
        node2-->node8
        node3-->node2
        node4-->node7
        node5-->node4
        node6-->node12
        node7-->node6
        node9-->node1
        node10-->node3
        node11-->node9
        node12-->node10
Loading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant