|
| 1 | +--- |
| 2 | +authors: [boegel] |
| 3 | +date: 2025-02-10 |
| 4 | +slug: integration-efp |
| 5 | +--- |
| 6 | + |
| 7 | +# Integration in the EuroHPC Federation Platform |
| 8 | + |
| 9 | +A couple of weeks ago the EuroHPC Joint Undertaking (EuroHPC JU) [announced the consortium that will develop the |
| 10 | +**EuroHPC Federation Platform (EFP)**](https://eurohpc-ju.europa.eu/paving-way-eurohpc-federation-platform-2024-12-19_en). |
| 11 | + |
| 12 | +This ambitious effort will deliver a 'one-stop shop' for researchers using the EuroHPC supercomputers, |
| 13 | +as well as the upcoming EuroHPC AI Factories and quantum computers, built with open source software. |
| 14 | + |
| 15 | +<figure markdown="span"> |
| 16 | +{width=70%} |
| 17 | +</figure> |
| 18 | + |
| 19 | +Ghent University is part of this consortium to **integrate EESSI into the EuroHPC Federation Platform** as common software stack. |
| 20 | + |
| 21 | +Henrik Nortamo (CSC), the technical lead of the EFP consortium, gave an excellent 20-minute talk on EFP |
| 22 | +last weekend in the 10th *HPC, Big Data, and Data Science* devroom at FOSDEM'25 in Brussels. |
| 23 | +**Slides and recording of the talk are available [here](https://fosdem.org/2025/schedule/event/fosdem-2025-6718-eurohpc-fp-a-federated-platform-for-hpc-infrastructure-in-europe-built-with-open-source-software/).** |
| 24 | + |
| 25 | +<!-- more --> |
| 26 | + |
| 27 | + |
| 28 | +## The EFP consortium |
| 29 | + |
| 30 | +The consortium that will develop the EuroHPC Federation Platform consists of: |
| 31 | + |
| 32 | +* [CSC](https://csc.fi/en) in Finland, the Hosting Entity for [LUMI](https://www.lumi-supercomputer.eu), as lead partner; |
| 33 | +* [IT4Innovations](https://www.it4i.cz/en) in Czech Republic, the Hosting Entitory for [Karolina](https://www.it4i.cz/en/infrastructure/karolina); |
| 34 | +* [Ghent University](https://www.ugent.be/en) in Belgium; |
| 35 | +* [University of Tartu](https://ut.ee/en) in Estonia; |
| 36 | +* [GÉANT](https://geant.org), the pan-European data network for the research and education community; |
| 37 | +* [NORDUnet](https://www.nordu.net), a Nordic collaboration connecting national research and education network; |
| 38 | + |
| 39 | +<figure markdown="span"> |
| 40 | +{width=100%} |
| 41 | +</figure> |
| 42 | + |
| 43 | +A productive kickoff meeting was held on 16+17 January 2025 in Helsinki, Finland. |
| 44 | + |
| 45 | +Each of the components of the federated platform were presented by and to the consortium partners, |
| 46 | +and practical aspects of executing the planned work in the coming months and years were discussed. |
| 47 | + |
| 48 | +## Scope and timeline of EFP |
| 49 | + |
| 50 | +The federated platform aims to facilitate access to and usage of the EuroHPC infrastructure. |
| 51 | + |
| 52 | +It will provide: |
| 53 | + |
| 54 | +* Federated Single-Sign-On, based on [MyAccessID](https://wiki.geant.org/display/MyAccessID); |
| 55 | +* Direct access using (short-lived) SSH certificates; |
| 56 | +* Web interface for interactive use, based on [Open OnDemand](https://openondemand.org); |
| 57 | +* Common software stack, based on [EESSI](https://eessi.io); |
| 58 | +* Resource allocation and management across systems, based on [Waldur](https://waldur.com); |
| 59 | +* Advanced workflows and data transfer, based on [LEXIS](https://docs.lexis.tech/) and [HEAppE](https://heappe.eu/); |
| 60 | + |
| 61 | +<figure markdown="span"> |
| 62 | +{width=100%} |
| 63 | +</figure> |
| 64 | + |
| 65 | +The development of the federated platform started just a couple of weeks ago (January 2025). |
| 66 | +An initial production version of the platform with currently online EuroHPC JU systems integrated |
| 67 | +is planned to be operational by March 2026. |
| 68 | + |
| 69 | +The work is funded by the EuroHPC Joint Undertaking, who is providing a total budget of ~20 million Euro |
| 70 | +to the EFP consortium for 2025-2029. |
| 71 | + |
| 72 | + |
| 73 | +## Powered by open source software |
| 74 | + |
| 75 | +<figure markdown="span"> |
| 76 | +{width=100%} |
| 77 | +</figure> |
| 78 | + |
| 79 | +!!! quote "Quote by Henrik Nortamo (CSC.fi), technical lead of EFP @ HPC devroom at FOSDEM'25" |
| 80 | + |
| 81 | + ***This would not be possible without open source.*** |
| 82 | + |
| 83 | + *If you consider the scope of the functionality, and the implicit understanding |
| 84 | + the implemented technologies have of user requirements, starting from scratch and |
| 85 | + compiling that into something sensible would be an *extremely* large job.* |
| 86 | + |
| 87 | + *Federation requires of course a degree of trust that our stuff works. |
| 88 | + With open source, somebody else is running it, you can have a look at it, you can go and check it out. |
| 89 | + It's much easier than going "here's my binary blob, please install it so that stuff works".* |
| 90 | + |
| 91 | + *Also on the promised features: I've shown you a bunch of stuff, I'm promising you many things |
| 92 | + which can be done. If this was a closed-source solution, which wasn't used anywhere |
| 93 | + and you couldn't look into it, you would probably think that "he's trying to bullshit us, there's no way". |
| 94 | + But now you know: yes, that is an open source component, it works there, I understand why it works, |
| 95 | + this could also work.* |
| 96 | + |
| 97 | + [(see also slides + recording of Henrik's talk on EuroHPC Federation Platform)](https://fosdem.org/2025/schedule/event/fosdem-2025-6718-eurohpc-fp-a-federated-platform-for-hpc-infrastructure-in-europe-built-with-open-source-software/) |
| 98 | + |
| 99 | + |
| 100 | +## EESSI as common software stack |
| 101 | + |
| 102 | +<figure markdown="span"> |
| 103 | +{width=70%} |
| 104 | +</figure> |
| 105 | + |
| 106 | +[EESSI](https://eessi.io/docs) will be integrated in the EuroHPC Federation Platform as a part of |
| 107 | +the *Federated Software Catalogue* component, a common software stack that will be available on the EuroHPC systems. |
| 108 | + |
| 109 | +Researchers will be able to consult which software is available on the various EuroHPC systems through |
| 110 | +the *Federated Software Listing* component of the federated platform. |
| 111 | + |
| 112 | + |
| 113 | +## Current status of EESSI on EuroHPC JU systems |
| 114 | + |
| 115 | +This work will foster a quick(er) and broad adoption of EESSI on EuroHPC infrastructure. |
| 116 | + |
| 117 | +We expect that there will also be a "trickle-down" effect to national and local supercomputers |
| 118 | +throughout Europe (and beyond) to also make EESSI available there in the short term. |
| 119 | + |
| 120 | +Today, EESSI is already available on various EuroHPC JU supercomputers, |
| 121 | +including Vega in Slovenia, Karolina in Czech Republic, and (the A64FX partition of) Deucalion in Portugal. |
| 122 | + |
| 123 | +Discussions with various other EuroHPC JU systems to also make EESSI available there are ongoing, including |
| 124 | +MeluXina in Luxembourg, MareNostrum 5 in Spain, LUMI in Finland, and JUPITER in Germany. |
| 125 | + |
| 126 | +An up-to-date overview of systems where EESSI is known to be available is available in the EESSI documentation: |
| 127 | +[https://eessi.io/docs/systems](https://www.eessi.io/docs/systems). |
0 commit comments