Skip to content

Commit fec26bd

Browse files
committed
fix pipeline catalog (?)
1 parent 5d944c8 commit fec26bd

File tree

2 files changed

+4
-17
lines changed

2 files changed

+4
-17
lines changed

argo-pipeline/pipeline.yaml

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -305,12 +305,7 @@ spec:
305305
mountPath: /mnt
306306
env: *env_parameters
307307

308-
- name: make-catalog
309-
outputs:
310-
parameters:
311-
- name: result
312-
valueFrom:
313-
path: "catalog/result.json"
308+
- name: make-catalogs
314309
container:
315310
image: inseefrlab/cartiflette:latest
316311
command: ["sh", "-c"]

argo-pipeline/src/catalog.py

Lines changed: 3 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -33,17 +33,9 @@ def main(
3333
fs: S3FileSystem = FS,
3434
):
3535

36-
success = True
37-
try:
38-
make_s3_inventory(
39-
fs=fs, bucket=bucket, path_within_bucket=path_within_bucket
40-
)
41-
except Exception:
42-
success = False
43-
44-
out_path = "catalog/result.json"
45-
with open(out_path, "w", encoding="utf8") as out:
46-
json.dump(success, out)
36+
make_s3_inventory(
37+
fs=fs, bucket=bucket, path_within_bucket=path_within_bucket
38+
)
4739

4840
logger.info("Success!")
4941

0 commit comments

Comments
 (0)