-
Notifications
You must be signed in to change notification settings - Fork 32
Closed
Labels
a:dask-serviceAny of the dask services: dask-scheduler/sidecar or workerAny of the dask services: dask-scheduler/sidecar or workera:simcore-sdk
Milestone
Description
Reference: ITISFoundation/osparc-issues#1619
As discussed in above issue, using deterministic zipping would ensure the SHA of the resulting zipping of a folder does not change with the timings.
-
try to use the solution proposed in https://zerostride.medium.com/building-deterministic-zip-files-with-built-in-commands-741275116a19there is a similar solution in python which works https://github.com/drivendataorg/repro-zipfile - check if the SHA generated is kept similar
This would reduce the need for uploading outputs when files inside the outputs did not change.
### MartinKippenberger
- [ ] https://github.com/ITISFoundation/osparc-simcore/issues/6474
- [ ] https://github.com/ITISFoundation/osparc-simcore/pull/6571
Metadata
Metadata
Assignees
Labels
a:dask-serviceAny of the dask services: dask-scheduler/sidecar or workerAny of the dask services: dask-scheduler/sidecar or workera:simcore-sdk