Invalid zarr.json

[tschaub]

Running eopf-geozarr convert, we are seeing zarr.json produced that includes "fill_value": NaN, making it invalid JSON.

Here is an example:

eopf-geozarr convert https://objects.eodc.eu/e05ab01a9d56408d82ac32d69a5aae2a:202510-s02msil2a-eu/25/products/cpm_v256/S2A_MSIL2A_20251025T095111_N0511_R079_T33SVB_20251025T121315.zarr ./s2l2_test.zarr --groups /measurements/reflectance/r20m /measurements/reflectance/r60m --crs-groups /conditions/geometry --spatial-chunk 512 --min-dimension 256 --tile-width 256 --max-retries 2 --verbose --enable-sharding

The resulting s2l2_test.zarr/zarr.json has 21 "fill_value": NaN members. This looks like it would come from something like float('nan') in python.

[d-v-b]

thanks for this report, definitely a bug. I will try to track this down

[emmanuelmathot]

This is ssue is originating from the CPM. Already reported: https://gitlab.eopf.copernicus.eu/cpm/eopf-cpm/-/issues/891

[ahocevar]

Since I cannot comment there, I'm adding here that using "NaN" instead of NaN would be a good way to encode this in JSON.

[d-v-b]

yes and this encoding is exactly what zarr uses internally. I'm not sure how that non-string NaN is getting in to the product metadata