Skip to content

Conversation

@axel-lauer
Copy link
Contributor

@axel-lauer axel-lauer commented Jan 29, 2025

Description

This PR add the recipe ref/recipe_ref_sea_ice_area_basic.yml to calculate the seasonal cycle of Arctic and Antarctic sea ice area as well as time series of the Arctic September and Antarctic February sea ice area for REF.

The new recipe requires

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.

New or updated recipe/diagnostic

@TomLav
Copy link

TomLav commented Mar 13, 2025

Hello, I am the PI for the ESACCI-SEAICE dataset. I am also the PI for another dataset (OSISAF/CCI) that is longer and more up-to-date (although coarser resolution).

I would suggest that the OSISAF/CCI dataset is used as a reference dataset by REF. Can I help getting the OSISAF/CCI dataset as reference for the two REF sea-ice metrics in ESMValTool?

The file format of ESACCI-SEAICE and OSISAF/CCI are identical, except for the filename convention, and the grid spacing (12.5km for ESACCI-SEAICE, and 25km for OSISAF/CCI).

@axel-lauer
Copy link
Contributor Author

I am adding sea ice area to the recipes. I am also running an updated version of the OSI-450 CMORizer to create the OSISAF/CCI v3.0 dataset for this recipe.

@axel-lauer axel-lauer changed the title Add recipe for seasonal cycle of Arctic/Antarctic sea ice extent (REF) Add recipe for seasonal cycle of Arctic/Antarctic sea ice area & extent (REF) Mar 21, 2025
@axel-lauer axel-lauer marked this pull request as draft March 21, 2025 12:27
@TomLav
Copy link

TomLav commented Mar 24, 2025

Hello @axel-lauer,

Thank you for your work bringing our data into ESMValTool

I do not know ESMValTool enough to find the information myself in the code, but I am wondering:

  • does this recipe start from daily SIC files, then computes daily sea-ice area, before averaging these to monthly SIA?
  • is the full range of sea-ice concentration considered when computing SIA or only SIC>=15% (it is better to have the full range)
  • is the recipe limited to 1995-2014? is it a REF or CMIP standard? the OSISAF/CCI dataset covers 1979-present
  • could the resulting SIA be referred / labelled with the "OSISAF/CCI" name?

@axel-lauer axel-lauer changed the title Add recipe for seasonal cycle of Arctic/Antarctic sea ice area & extent (REF) Add recipe for seasonal cycle and time series of Arctic/Antarctic sea ice area (REF) Mar 24, 2025
@axel-lauer
Copy link
Contributor Author

Thank you for your work bringing our data into ESMValTool

Thanks for pointing us to the new dataset. I just opened a pull request to update the OSISAF/CCI (aka OSI-450) from version 2 to version 3 (#3963).

I do not know ESMValTool enough to find the information myself in the code, but I am wondering:

  • does this recipe start from daily SIC files, then computes daily sea-ice area, before averaging these to monthly SIA?

The REF recipe uses the monthly means directly.

  • is the full range of sea-ice concentration considered when computing SIA or only SIC>=15% (it is better to have the full range)

At first, we used sea ice extent (SIC >= 15%) but we now changed this to sea ice area (calculated as the sum of the sea ice fraction in each grid cell multiplied by the grid cell area).

  • is the recipe limited to 1995-2014? is it a REF or CMIP standard? the OSISAF/CCI dataset covers 1979-present

The time period 1995-2014 is currently used for calculation of the average seasonal cycle and matches the last 20 years of data from the historical CMIP6 simulations. This could be adjusted once the first CMIP7 data are available. The newly added time series of Arctic September and Antarctic March sea ice area cover the full period of the OSISAF/CCI dataset (1979-2020).

  • could the resulting SIA be referred / labelled with the "OSISAF/CCI" name?

Sure, I changed this in the plots produced by basic sea ice diagnostics for REF (recipe_ref_sea_ice_area_basic.yml) (#3891).

@axel-lauer axel-lauer marked this pull request as ready for review March 24, 2025 12:24
@TomLav
Copy link

TomLav commented Mar 24, 2025

The newly added time series of Arctic September and Antarctic March sea ice area cover the full period of the OSISAF/CCI dataset (1979-2020).

FYI: the OSI-450 CDR covers 1979-2020. It is extended from 01.01.2021 to present with our Interim CDR. The Interim CDR has codename OSI-430, its sea-ice area can be appended to OSI-450 under the label "OSISAF/CCI". The OSI-430 files have exactly the same format as OSI-450, but are found in a separate location:

This in case you want to append more recent years to the SIA timeseries.

The newly added time series of Arctic September and Antarctic March

We usually consider that February is the month with minimum yearly sea-ice area in the Antarctic (but March might be a decision by CMIP or REF).

image

@TomLav
Copy link

TomLav commented Mar 24, 2025

does this recipe start from daily SIC files, then computes daily sea-ice area, before averaging these to monthly SIA?

The REF recipe uses the monthly means directly.

The original monthly SIC data is on equal area 25x25km grid, so the area of all grid cells is 625km^2. Also, the grid cells with a valid (non-NaN) SIC have no fractional land, so the whole (625km^2 * SIC) contributes to SIC (no need to weight with Ofx).

Sorry if the above is obvious, I just want to double-check the computation that goes to REF.

@axel-lauer
Copy link
Contributor Author

axel-lauer commented Mar 24, 2025

FYI: the OSI-450 CDR covers 1979-2020. It is extended from 01.01.2021 to present with our Interim CDR. The Interim CDR has codename OSI-430, its sea-ice area can be appended to OSI-450 under the label "OSISAF/CCI". The OSI-430 files have exactly the same format as OSI-450, but are found in a separate location:

So far, we did not use ICDR values as we were afraid it would be quite hard to keep track of which actual data has been used in case the ICDR record gets updated.

The newly added time series of Arctic September and Antarctic March

We usually consider that February is the month with minimum yearly sea-ice area in the Antarctic (but March might be a decision by CMIP or REF).

Thanks for spotting this. I just changed the time series of Antarctic sea ice area from March to February (5d26b08).

@axel-lauer
Copy link
Contributor Author

does this recipe start from daily SIC files, then computes daily sea-ice area, before averaging these to monthly SIA?

The REF recipe uses the monthly means directly.

The original monthly SIC data is on equal area 25x25km grid, so the area of all grid cells is 625km^2. Also, the grid cells with a valid (non-NaN) SIC have no fractional land, so the whole (625km^2 * SIC) contributes to SIC (no need to weight with Ofx).

The data remain on their native 25x25 km grid. For irregular grids (i.e. 2-dim latitude and longitude values), ESMValTool usually simply uses the grid cell areas (here "areacello") provided for the particular grid for calculations instead of trying to estimate the grid cell areas. Even though in case of OSISAF/CCI, all values of the field areacello are constant (625 km^2), having such a "fx" file makes running ESMValTool easier.

@axel-lauer axel-lauer requested a review from hb326 March 24, 2025 13:22
@TomLav
Copy link

TomLav commented Mar 24, 2025

Thank you for answering my questions @axel-lauer .

In case you want to check the results of the present recipe, we distribute a monthly sea-ice area product from OSI-450/OSI-430:

Others than that I have nothing to add :)

pyplot_kwargs:
title: 'Sea ice area (million km2)'
plot_kwargs:
'MPI-ESM1-2-LR':
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want this to be hard-coded? It probably would need to be a little more flexible when implemented in the REF so that it just refers to the model that is used.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good point. Changed here: 87b2ad5

Copy link
Contributor

@hb326 hb326 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @hb326 for the review. I addressed your three comments in this commit: 87b2ad5

Copy link
Contributor

@hb326 hb326 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@axel-lauer: thanks for the changes!
Looks good to me now.
👍

Copy link
Contributor

@schlunma schlunma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Axel, recipe looks good and works perfectly fine 🚀

Could you please solve the merge conflict?

@axel-lauer
Copy link
Contributor Author

Could you please solve the merge conflict?

Done!

@TomLav
Copy link

TomLav commented Mar 28, 2025

Just a comment to say that I am positively impressed by the process of developing this metric, and the fact that it involved an assigned scientific reviewer (and a scientific review period).

This is probably not the right place to make such a suggestion, but I would still put down that (when possible) the scientific review should also involve the PI of the observation dataset. Both because we can help accessing and using the data, but also because we are then aware of the use in ESMValTool and can inform when changes or new version are made.

As a matter of fact, I can inform you that a new (bug-fix) release of the OSISAF/CCI dataset is underway that will (marginally) change the sea-ice areas computed with this recipe. This will be v3.1 (OSI-450-a1) that should be released in the next month. The sea-ice area computed by the current recipe (from v3.0) are perfectly ok for scientific exploitation by REF and other users. But the new ones (from v3.1) will be marginally better.

It is fine for me if you want to close this PR and I open an issue later when the OSISAF/CCI v3.1 is released.

@axel-lauer
Copy link
Contributor Author

This is probably not the right place to make such a suggestion, but I would still put down that (when possible) the scientific review should also involve the PI of the observation dataset. Both because we can help accessing and using the data, but also because we are then aware of the use in ESMValTool and can inform when changes or new version are made.

That's a very good idea. In most cases, though, dataset PIs are unfortunately not available for this task. So thanks for sharing your expertise with us here!!

As a matter of fact, I can inform you that a new (bug-fix) release of the OSISAF/CCI dataset is underway that will (marginally) change the sea-ice areas computed with this recipe. This will be v3.1 (OSI-450-a1) that should be released in the next month. The sea-ice area computed by the current recipe (from v3.0) are perfectly ok for scientific exploitation by REF and other users. But the new ones (from v3.1) will be marginally better.

Thanks for letting us know. From the ESMValTool side, it would be very easy to switch from v3.0 to v3.1 once available. But I am not sure the tight REF schedule allows for waiting for v3.1. We will check how it would work to update recipes or reference datasets at a later stage.

It is fine for me if you want to close this PR and I open an issue later when the OSISAF/CCI v3.1 is released.

That would be great and we would be very happy to hear about v3.1 once the dataset is released.

Copy link
Contributor

@schlunma schlunma left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thanks @axel-lauer and everyone for contributing. This can be merged 🚀

@schlunma schlunma merged commit eb2972a into main Mar 28, 2025
8 checks passed
@schlunma schlunma deleted the ref_sea_ice_extent branch March 28, 2025 10:38
ehogan added a commit that referenced this pull request Apr 7, 2025
* main: (43 commits)
  use python-only environment file for Circle build documentation (#3981)
  Added option to plot horizontal lines in monitoring line plots (#3977)
  [Condalock] Update Linux condalock file (#3974)
  Run esmvalbot test PR twice a month (#3976)
  unpin upper limit `r-base` (#3971)
  [Condalock] Update Linux condalock file (#3968)
  Update CMORizer for OSI-450 aka OSISAF/CCI (sea ice concentration) (#3963)
  Add recipe for seasonal cycle and time series of Arctic/Antarctic sea ice area (REF) (#3891)
  use Python-only environment for ReadTheDocs builds (#3955)
  [Condalock] Update Linux condalock file (#3961)
  Create scatterplots for the REF (#3923)
  [Condalock] Update Linux condalock file (#3957)
  Unsafe and manual fixes
  Automatic fixes
  Replace flake8, yapf, and isort with ruff
  Add recipe and diagnostic for ZEC (Zero Emissions Commitment) (#3897)
  Update ESACCI-OZONE CMORizer(formatter and downloader) for REF (#3899)
  Update citation and changelog for version 2.12 (#3945)
  use mamba>=2 for Circle CI upstream development test (#3949)
  Force install mamba2 in CircleCI and add ipython and pin it to <9.0 (#3947)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved by scientific reviewer approved by technical reviewer REF Important for the CMIP Rapid Evaluation Framework (REF)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Arctic/Antarctic sea ice extent (seasonal cycle) REF

5 participants