fix(package): Refactor dataset handling in the package.#1023

Merged

haiqi96 merged 42 commits intoy-scope:mainfrom

haiqi96:DatasetRefactor

Jul 3, 2025

Commits on Jun 20, 2025

Commits on Jun 25, 2025

Merge branch 'main' into DatasetRefactor
haiqi96
committed

Commits on Jun 27, 2025

Commits on Jun 29, 2025

Commits on Jun 30, 2025

Address review comments
Bill-hbrhbr
committed
Replace the missing SUFFIX
Bill-hbrhbr
committed
Move suffix constants from clp_config to clp_metadata_db_utils local scope
Bill-hbrhbr
committed
Refactor archive_manager.py.
kirkrodrigues
committed
Refactor s3_utils.py.
kirkrodrigues
committed
compression_task.py: Fix typing errors and minor refactoring.
kirkrodrigues
committed
compression_scheduler.py: Remove exception swallow which will hide unexpected errors; Fix incomplete refactoring.
kirkrodrigues
committed
Refactor query_scheduler.py.
kirkrodrigues
committed
clp_metadata_db_utils.py: Minor refactoring.
kirkrodrigues
committed
clp_metadata_db_utils.py: Rename _generic_get_table_name -> _get_table_name and add docstring.
kirkrodrigues
committed
clp_metadata_db_utils.py: Alphabetize new public functions.
kirkrodrigues
committed
clp_metadata_db_utils.py: Reorder public and private functions for consistency.
kirkrodrigues
committed
initialize-clp-metadata-db.py: Remove changes unrelated to PR.
kirkrodrigues
committed
Move default dataset creation into compression_scheduler so that it runs within an execution container.
kirkrodrigues
committed

Commits on Jul 3, 2025

Merge branch 'main' into DatasetRefactor
haiqi96
authored