CDDS v2.5.3

What's Changed

CDDS:

• Adaptations needed for new CMIP6Plus MIP tables including a CMIP6Plus plugin and changes to how MIP tables are used (CDDSO-336 @mo-kerstinschmatzer #168, CDDSO-365 @matthew-mizielinski #192)
• Adaptations needed to support use of sub_experiment_ids that are not “none” (CDDSO-365, CDDSO-362 @matthew-mizielinski #190)
• Extract can again correctly retrieve sub-daily data (CDDSO-358, @piotr-florek-mohc #188)
• The update_directives script in the per-stream suite now correctly calculate upper limits for memory / wall time / local storage (CDDSO-360, @mo-jareddrayton )

MIP Convert:

• Adaptations needed for new CMIP6Plus MIP tables including a CMIP6Plus plugin and changes to how MIP tables are used (CDDSO-336 @mo-kerstinschmatzer #168, CDDSO-365 @matthew-mizielinski #192)
• Update to version of CMOR to 3.6.3 (CDDSO-368, @matthew-mizielinski #194)

Full Changelog: v2.5.2...v2.5.3

CDDS v2.5.2

What's Changed

• CDDSO-311 warn user if specified branch name does not exist in checkout processing workflow script by @mo-jareddrayton in #160
• Cddso 331 remove cdds plugin calls from mip convert by @mo-kerstinschmatzer in #167
• CDDSO-325 remove zero size files by @piotr-florek-mohc in #169
• CDDSO-338 use calendar in request in QC by @mo-kerstinschmatzer in #170
• CDDSO-339 remove breakpoint in checkout processing workflow script by @mo-jareddrayton in #171
• CDDSO-333 re-enable cell_methods checking by @piotr-florek-mohc in #172
• CDDSO-341 handle incomplete writes by @piotr-florek-mohc in #177
• CDDSO-325 add root and break for top-level files only by @piotr-florek-mohc in #174
• CDDSO-212 investigate dynamically allocating resources in the cdds convert workflow ak283 during runtime by @mo-jareddrayton in #182
• CDDSO-350 fix bug in netcdf filename format by @piotr-florek-mohc in #180
• CDDSO-357: update cmor version and re-resolve environments by @matthew-mizielinski in #184
• CDDSO-239 Prepare 2.5.2 release by @mo-kerstinschmatzer in #185

Full Changelog: v2.5.1...v2.5.2

CDDS v2.5.1

What's Changed

• CDDSO-328 Update mapping of variable zos for HadGEM3 by @mo-kerstinschmatzer in #159
• CDDSO-327: added --no_cell_methods argument to ncrcat by @piotr-florek-mohc in #162
• CDDSO-326 fix calendar initialisation in qc validators by @piotr-florek-mohc in #161
• CDDSO-326 reset calendar singleton by @piotr-florek-mohc in #163
• CDDSO-281 v2.5.1 release by @piotr-florek-mohc in #164

Full Changelog: v2.5.0...v2.5.1

CDDS v2.5.0

What's Changed

Full Changelog: v2.4.0...v2.5.0

CDDS

• Migrate CDDS to Cylc 8 (CDDSO-282, CDDSO-285)
• Introduce gregorian calendar support (CDDSO-231, CDDSO-235, CDDSO-240, CDDSO-244)
• Plugin and code development to support Regional models for projects such as CORDEX
  (CDDSO-233, CDDSO-68, CDDSO-74, CDDSO-261, CDDSO-149)
• CDDS now uses ISO datetime format for all time values in CDDS and MIP Convert config
  files (CDDSO-313, CDDSO-45)
• Relocate test and etc directories to support alternate platforms and migration to
  azure SPICE (CDDSO-131, CDDSO-273)
• Replace pep8 with pycodestyle (CDDSO-207)
• Separated extract validation into a separate script & task (CDDSO-243)
• Introduced retries to workflow tasks when submission fails (CDDSO-314)
• Amalgamated CDDS processing and ensemble processing workflows. Previous tools based on u-cq805 and u-cr273 are deprecated (CDDSO-319)
• Updated CMOR to version 3.7.2, which required iris update to 3.4.1 (CDDSO-321)

MIP Convert

• Updated CMOR to version 3.7.2, which required iris update to 3.4.1 (CDDSO-321)
• Relocated test data to enable testing on multiple platforms (CDDSO-278)
• Change date format in config file to ISO datetime (CDDSO-294, CDDSO-313)

CDDS v2.4.7

What's Changed

• CDDSO-308 update read_default_arguments by @piotr-florek-mohc in #142

Full Changelog: v2.4.6...v2.4.7

Please note that this release has been installed only on JASMIN, as its only purpose is to fix a bug affecting halo removal script which is not used in the standard MO data processing workflow.

On main the bug has been already fixed in #96.

CDDS v2.4.6

What's Changed

• CDDSO-291 Eday evspsbl mapping by @matthew-mizielinski in #134
• CDDSO-289 modified chunking logic and unit tests by @piotr-florek-mohc in #133
• CDDSO-245 optimise netCDF4 chunking @piotr-florek-mohc in #135
• CDDSO-293: remove erroneous y dimension filtering from diaptr files in GCModelDev MM models by @matthew-mizielinski in #136

Full Changelog: v2.4.5...v2.4.6

v2.4.5

What's Changed

• CDDSO-276 cherry-pick Highres models from main by @mo-jareddrayton in #123
• CDDSO-275: Introduce cice daily time coord fix and siconc mapping by @matthew-mizielinski in #125

Full Changelog: v2.4.4...v2.4.5

CDDS v2.4.4

What's Changed

CDDS

• Added options to use a “relaxed” approach to MIP name (activity_id) and experiment id, that does not force checks from the CVs. This will allow users to process data as any experiment id they like, but at the risk of typos due to the lack of checks against a controlled vocabulary (CDDSO-253 , CDDSO-267, CDDSO-264)
• prepare_alter_variable_list can now perform insert commands again as plugin was not being loaded, which was needed for setting streams (CDDSO-269)
• checkout_processing_suite now sets the streams in the suite based on those in the request file. (CDDSO-271)

MIP Convert

No changes

Full Changelog: v2.4.3...v2.4.4

CDDS v2.4.3

What's Changed

CDDS

• Add support for retries in the run_extract task within the CDDS Convert Suite (CDDSO-258)

Mip Convert

• Add a --relaxed-cmor option to mip_convert. When used certain metadata fields e.g.
  experiment_id are not checked against the controlled vocabularies (CDDSO-252).
• All ancillary STASH codes are now correctly treated as time invariant (CDDSO-247).

Full Changelog: v2.4.2...v2.4.3

CDDS v2.4.2

What's Changed

• CDDSO-238 Add conditional suite prefix to netCDF4 filename templates in extract
• CDDSO-239 Custom mappings for GC3.05 zostoga

Full Changelog: v2.4.1...v2.4.2