Skip to content

feat(topographic-system): Update the map produce workflow to use stac-push. BM-1624#1188

Open
Wentao-Kuang wants to merge 1 commit intomasterfrom
feat/map-produce-stac-push
Open

feat(topographic-system): Update the map produce workflow to use stac-push. BM-1624#1188
Wentao-Kuang wants to merge 1 commit intomasterfrom
feat/map-produce-stac-push

Conversation

@Wentao-Kuang
Copy link
Copy Markdown
Contributor

Motivation

We are not ready to use stac-push for the map produce workflow.

Modifications

  • update the map-produce workflow to use the stac-push cmd instead of copy, so that we can have the strategy included and upsert the catalogs.
  • Delete duplicated sheet-produce workflow, which is same as map-produce workflow when set produce_all=false

Verification

https://argo.linzaccess.com/workflows/argo/test-topographic-map-produce-wentao-pr-119-zq74b?tab=workflow&nodeId=test-topographic-map-produce-wentao-pr-119-zq74b-1921968635&nodePanelView=containers&uid=e4fe5e49-5727-4c0e-acf7-50e7133c3d13

- name: cover-items
path: /tmp/produce/cover-items.json
container:
image: 725496895483.dkr.ecr.ap-southeast-2.amazonaws.com/github/linz/topographic-system/map:{{ inputs.parameters.version_map_cli }}
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should be using the github pull through cache if we can.

--target={{ inputs.parameters.target }} \
--category=product \
--strategy=date \
$( [ "{{ inputs.parameters.latest }}" = "true" ] && echo "--strategy=latest" ) \
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be best if we could use sprig to format the args so we can avoid the bash -c

Im not entirely sure what the sprig logic looks like but hopefully something like

{{= inputs.parameters.latest == "true" ?  "--strategy=latest" : "" }}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants