Skip to content

🐛 unarchiving_utils are now based on 7zip cli #6959

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 74 commits into from
Jan 7, 2025
Merged

🐛 unarchiving_utils are now based on 7zip cli #6959

Show file tree
Hide file tree
Changes from 57 commits
Commits
Show all changes
74 commits
Select commit Hold shift + click to select a range
97fd911
move archive to port instead of failing
Dec 12, 2024
29533e9
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 12, 2024
ca87d0b
using log context and rename
Dec 13, 2024
7f3e41e
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 13, 2024
be58b0c
refactor to use less generic error UnsupportedArchiveFormat
Dec 13, 2024
53e0728
renaming error
Dec 13, 2024
65b5291
replace unarchiver
Dec 16, 2024
e6d118d
remove unused
Dec 16, 2024
2a2f917
remove comment
Dec 16, 2024
56d7fe1
refactor 7zip
Dec 16, 2024
9c82bc5
fixed broken install
Dec 16, 2024
5a4cfb5
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 16, 2024
0f315e0
refactor
Dec 16, 2024
7ede41a
mypy
Dec 16, 2024
9d67dd1
added extra test
Dec 16, 2024
0f1642d
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 17, 2024
71adc5b
move to folder
Dec 17, 2024
01ce053
small enhancements in tests
Dec 17, 2024
79c1648
restructure package
Dec 17, 2024
02c9497
modules renaming
Dec 17, 2024
c01e35a
refactor
Dec 17, 2024
13c1485
fix refactor
Dec 17, 2024
653e168
added decompress progress
Dec 17, 2024
6dfcd95
fixed issues with parsing progress
Dec 17, 2024
c3b0c1c
restructure tests with common utils
Dec 19, 2024
56d1871
added notes to deprecate
Dec 19, 2024
30346af
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 19, 2024
a9145e2
remove unwanted code
Dec 19, 2024
46a0c29
remove unused
Dec 19, 2024
c04999c
removed unused feature
Dec 19, 2024
d48de81
refactor to drop relative_paths since it's always True
Dec 19, 2024
9ff2374
added tqdm progress
Dec 19, 2024
0364e8b
refactor common code
Dec 19, 2024
7205c2f
connected progressbar
Dec 19, 2024
79cc7e8
added dropin interface
Dec 19, 2024
e69bc9a
remove old unused interface
Dec 19, 2024
e282c95
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 19, 2024
7279155
removes unused repro-zipfile
Dec 19, 2024
571a411
refactor imports
Dec 19, 2024
da30d13
restructure model
Dec 19, 2024
9ca1090
simplify outputs parsing
Dec 19, 2024
97bdff1
install path is now fixed to avoid using old system versions
Dec 20, 2024
280b0d3
fixed 7z installation
Dec 20, 2024
6759dc7
enhanced 7zip interface
Dec 20, 2024
4a5a3a6
added arm64 target install
Dec 20, 2024
21c7f0a
fixed lines scanning parsing
Dec 20, 2024
a58849f
added edge case test
Dec 20, 2024
f5ae500
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Dec 20, 2024
abc45ef
refactor
Dec 20, 2024
82413f1
refactor
Dec 20, 2024
cbf7533
rename
Dec 20, 2024
5739963
mypy
Dec 20, 2024
9495ac1
making flatter
Dec 20, 2024
d693eeb
revert change
Dec 20, 2024
7e5b967
adding missing
Dec 20, 2024
05ab2f1
remove unused
Dec 20, 2024
7041eee
remove useless
Dec 20, 2024
622bb66
rename
Dec 20, 2024
2ddc4df
refactor errors and re
Dec 23, 2024
d2de8be
replaced regex search with complied expressions
Dec 23, 2024
010fe01
feedback
Dec 23, 2024
09cc78b
human readable refacto
Jan 6, 2025
cfb5f6d
revert
Jan 6, 2025
e825e07
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Jan 6, 2025
9d028bd
extract percentage via regex
Jan 7, 2025
f791538
only one log handler is supported
Jan 7, 2025
6d8c10a
rename
Jan 7, 2025
3881d18
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Jan 7, 2025
3a9de60
remove meaningless comment
Jan 7, 2025
805bd9e
fixed parsing issue
Jan 7, 2025
fd58947
fixed issue with file listing
Jan 7, 2025
229b9aa
removing archive after download
Jan 7, 2025
8ec0c9f
Merge remote-tracking branch 'upstream/master' into pr-osparc-deflate…
Jan 7, 2025
b14d359
revert upgraded
Jan 7, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 12 additions & 0 deletions ci/github/helpers/install_7zip.bash
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
#!/bin/bash
#
# Installs the latest version of 7zip plugin
#

# http://redsymbol.net/articles/unofficial-bash-strict-mode/
set -o errexit # abort on nonzero exitstatus
set -o nounset # abort on unbound variable
set -o pipefail # don't hide errors within pipes
IFS=$'\n\t'

exec "$( dirname -- "$0"; )"/../../../scripts/install_7zip.bash
1 change: 1 addition & 0 deletions ci/github/integration-testing/dynamic-sidecar.bash
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ install() {
make devenv
# shellcheck source=/dev/null
source .venv/bin/activate
sudo ./ci/github/helpers/install_7zip.bash
pushd services/dynamic-sidecar
make install-ci
popd
Expand Down
1 change: 1 addition & 0 deletions ci/github/integration-testing/webserver.bash
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ install() {
make devenv
# shellcheck source=/dev/null
source .venv/bin/activate
sudo ./ci/github/helpers/install_7zip.bash
pushd services/web/server
make install-ci
popd
Expand Down
1 change: 1 addition & 0 deletions ci/github/unit-testing/dynamic-sidecar.bash
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ install() {
make devenv
# shellcheck source=/dev/null
source .venv/bin/activate
sudo ./ci/github/helpers/install_7zip.bash
pushd services/dynamic-sidecar
make install-ci
popd
Expand Down
1 change: 1 addition & 0 deletions ci/github/unit-testing/service-library.bash
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ install_all() {
make devenv
# shellcheck source=/dev/null
source .venv/bin/activate
sudo ./ci/github/helpers/install_7zip.bash
pushd packages/service-library
make "install-ci[all]"
popd
Expand Down
2 changes: 0 additions & 2 deletions packages/aws-library/requirements/_base.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -313,8 +313,6 @@ referencing==0.29.3
# via
# jsonschema
# jsonschema-specifications
repro-zipfile==0.3.1
# via -r requirements/../../../packages/service-library/requirements/_base.in
requests==2.32.3
# via opentelemetry-exporter-otlp-proto-http
rich==13.8.1
Expand Down
1 change: 0 additions & 1 deletion packages/service-library/requirements/_base.in
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,6 @@ pydantic
pyinstrument
pyyaml
redis
repro-zipfile
tenacity
toolz
tqdm
Expand Down
2 changes: 0 additions & 2 deletions packages/service-library/requirements/_base.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -223,8 +223,6 @@ referencing==0.29.3
# via
# jsonschema
# jsonschema-specifications
repro-zipfile==0.3.1
# via -r requirements/_base.in
requests==2.32.3
# via opentelemetry-exporter-otlp-proto-http
rich==13.8.1
Expand Down
Loading
Loading