What should the Euclid Q1 tables be called in the parquet schema? #430
Description
Twelve Euclid Q1 tables have been combined into one in the parquet product. Some of the original column names overlap, so it is necessary to add a table identifier (name) to those column names for technical reasons (column names need to be unique) and also for provenance/understandability. For example, 'DECLINATION' -> 'MER_DECLINATION'. It was decided that the best option is to add a table identifier to all column names other than OBJECT_ID and TILEID (which are not table-specific). The remaining question is, what should those table names be?
Our naming criteria includes:
- [Required] A user who is familiar with the Q1 tables ought to be able to figure out which table is being referred to based on the name only.
- [Desired] Short names, since they will be prepended to all column names and many column names are already quite long.
- [Desired] Consistency with IRSA services.
For reference, here is the section of the demo notebook (irsa-tutorials/pull/108) that introduces the tables and their names:
Euclid Q1 tables and docs
The Euclid Q1 HATS Catalog includes the following twelve Q1 tables[*], which are organized underneath the Euclid processing function (MER, PHZ, or SPE) that created it.
Links to the Euclid papers describing the processing functions are provided, as well as pointers for each table.
Table names are linked to their original schemas.
- MER processing function - Euclid Collaboration: Romelli et al., 2025 (hereafter, Romelli)
- PHZ processing function - Euclid Collaboration: Tucci et al., 2025 (hereafter, Tucci)
- PHZ - Sec. 5 (phz_photo_z)
- CLASS - Sec. 4 (phz_classification)
- PHYSPARAM - Sec. 6 (6.1; phz_physical_parameters) Notice that this is galaxies and uses a different algorithm.
- GALAXYSED - App. B (B.1 phz_galaxy_sed)
- PHYSPARAMQSO - Sec. 6 (6.2; phz_qso_physical_parameters)
- STARCLASS - Sec. 6 (6.3; phz_star_template)
- STARSED - App. B (B.1 phz_star_sed)
- PHYSPARAMNIR - Sec. 6 (6.4; phz_nir_physical_parameters)
- SPE processing function - Euclid Collaboration: Le Brun et al., 2025 (hereafter, Le Brun)
- Z - Sec. 2 (spectro_zcatalog_spe_quality, spectro_zcatalog_spe_classification, spectro_zcatalog_spe_galaxy_candidates, spectro_zcatalog_spe_star_candidates, and spectro_zcatalog_spe_qso_candidates)
See also:
- MER Photometry and Morphology Cookbooks
- Frequently Asked Questions About Euclid Q1 data (hereafter, FAQ)
- Q1 Explanatory Supplement
[*] Euclid typically calls these "catalogs", but this notebook uses "tables" to avoid any confusion with the HATS Catalog product.