Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
57 commits
Select commit Hold shift + click to select a range
74e5871
rebased
neumannd Dec 5, 2024
681f6cc
adaptions to core before merging with Flos recent updates
neumannd Dec 5, 2024
a0c9f26
gitignore updates
neumannd Dec 5, 2024
201015a
ran linters
neumannd Dec 5, 2024
f935b49
code adapted to linter results in github
neumannd Dec 5, 2024
4d57ae9
code adapted to linter results in github; part 2
neumannd Dec 5, 2024
7db448c
code adapted to linter results in github; part 3
neumannd Dec 5, 2024
08cb311
ran black
neumannd Dec 5, 2024
2ad329a
added changes in tests by Flo
neumannd Dec 5, 2024
74a308b
ran black for tests
neumannd Dec 5, 2024
cc9d929
ran black for tests; part 2
neumannd Dec 5, 2024
6177bc9
ran black for tests; part 3
neumannd Dec 5, 2024
8a8dc66
further adaptions for tests; part 1
neumannd Dec 5, 2024
c35cefc
further adaptions for tests; part 2
neumannd Dec 5, 2024
dc371f9
further adaptions for tests; part 3
neumannd Dec 5, 2024
a82f25b
created typedDict
neumannd Dec 6, 2024
8e61e7b
updated typedDict
neumannd Dec 6, 2024
3d758f6
updated typedDict
neumannd Dec 6, 2024
e268665
retrieve writes missing files to files in cache dir
neumannd Dec 10, 2024
f2241ed
fix: small fixes to attribute/method calls to pyslk
doguskbilir Jan 28, 2025
13f5f28
tests(conftest.py): first working prototype for pyslk mocks
doguskbilir Jan 30, 2025
e263767
tests(conftest.py): add mock pyslk exception, type annotations from o…
doguskbilir Feb 3, 2025
707fd20
chore: run black
doguskbilir Feb 3, 2025
fb83021
tests(conftest.py): fix type annotation after flake8 complains
doguskbilir Feb 3, 2025
c611f89
fix(deps): restrict zarr to <3.0.0 to prevent breaking changes
doguskbilir Feb 4, 2025
7645d06
updated comments; fixed #5; fixed #6
neumannd Feb 10, 2025
53fbbc2
updated pre-commit-config; temporary removed docformatter
neumannd Feb 22, 2025
3a3a96e
core: split new retrieval code into multiple functions
neumannd Feb 22, 2025
afa66ae
updated pre commit config
neumannd Feb 22, 2025
1b34c4f
reordered impors in conftest
neumannd Feb 22, 2025
8f1fef4
fixed bug
neumannd Feb 22, 2025
3892275
files are only considered for retrieval when recall started
neumannd Feb 24, 2025
1be5a33
removed setup.py which accidentally reappeared
neumannd Feb 24, 2025
090dd40
fixed order recall retrieve
neumannd Feb 25, 2025
980e990
updated pyslk Mock
neumannd Feb 26, 2025
c084d3a
fixed issues core.py
neumannd Feb 26, 2025
22e85e2
updated pre-commit hooks
neumannd Feb 26, 2025
00e3f0b
black py310 linting done
neumannd Feb 26, 2025
a72a375
updated pre-commit hooks
neumannd Feb 26, 2025
d3acd9b
minor dcstring change conftest
neumannd Feb 26, 2025
82e7279
minor dcstring change conftest
neumannd Feb 26, 2025
d988dae
check preconfig hooks
neumannd Feb 26, 2025
73a62d5
re-run pre-commit hooks for core.py
neumannd Feb 26, 2025
ce4f13d
fixed issues in core.py
neumannd Feb 26, 2025
ec613eb
corrected core.py
neumannd Feb 27, 2025
34831a6
updated core and tests
neumannd Feb 27, 2025
1dc6a18
updated core and tests
neumannd Feb 27, 2025
c779097
updated core and tests
neumannd Feb 27, 2025
9236be6
final correction core.py
neumannd Feb 27, 2025
3556132
fixed #9; fixed wrong counting of not-recalled files
neumannd Mar 3, 2025
71dc9e0
throw exception when not all files retrieved; fixed #8
neumannd Mar 3, 2025
ec0891b
throw exception when not all files retrieved; fixed #8
neumannd Mar 3, 2025
a90eb03
fixed issue in check of completeness of porcess
neumannd Mar 3, 2025
6489cc0
changed pyslk dependency: pyslk is not at PyPI
neumannd Mar 3, 2025
ebd05d8
reduced complexity of core.py
neumannd Mar 12, 2025
648cfc2
fixed minor issue in core.py
neumannd Mar 12, 2025
470c97f
updated changelog
neumannd Mar 13, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -30,3 +30,7 @@ MANIFEST
.coverage
coverage.xml
report.xml

# IDEs
.idea

19 changes: 9 additions & 10 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
@@ -1,31 +1,30 @@
repos:

- repo: https://github.com/pre-commit/pre-commit-hooks
rev: v3.4.0
rev: v5.0.0
hooks:
- id: trailing-whitespace
- id: end-of-file-fixer
- id: check-docstring-first
- id: check-json
- id: check-yaml
- repo: https://github.com/pre-commit/mirrors-mypy
rev: v0.991
rev: v1.15.0
hooks:
- id: mypy
exclude: ^slkspec/tests
- repo: https://github.com/psf/black
rev: 22.10.0
rev: 25.1.0
hooks:
- id: black
args: ["--line-length=88", "--target-version=py310"]
- repo: https://github.com/pycqa/flake8
rev: 5.0.4
rev: 7.1.2
hooks:
- id: flake8
args: ["--max-line-length=88", "--max-complexity=10", "--doctests"]
- repo: https://github.com/pre-commit/mirrors-isort
rev: v5.7.0
rev: v5.10.1
hooks:
- id: isort
- repo: https://github.com/PyCQA/docformatter
rev: v1.5.0
hooks:
- id: docformatter
args: [--in-place]
args: ["--profile", "black"]
5 changes: 5 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,10 @@
# Changelog

## v0.0.3
- adapted to ``pyslk`` version >= 2.0.0
- improved and parallelized retrieval workflow
- dependency on ``pyslk`` available via PyPI (and not DKRZ GitLab Repo)

## v0.0.2
- Add CHANGELOG [#50](https://github.com/observingClouds/slkspec/pull/50)
- Modernize packaging with pyproject.toml [#49](https://github.com/observingClouds/slkspec/pull/49)
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ classifiers = [
requires-python = ">=3.9"
dependencies = [
"fsspec>=0.9.0",
"pyslk @ git+https://gitlab.dkrz.de/hsm-tools/pyslk.git@master"
"pyslk>=2.2.9",
]

[project.entry-points."fsspec.specs"]
Expand Down
Loading