Skip to content

Commit d91ef76

Browse files
authored
Merge pull request #380 from boegel/blog_post_efp
add blog post on integration of EESSI into EuroHPC Federation Platform
2 parents 8d074a2 + 01aed8f commit d91ef76

File tree

6 files changed

+127
-0
lines changed

6 files changed

+127
-0
lines changed
39.6 KB
Loading
62.8 KB
Loading
60.6 KB
Loading
125 KB
Loading
Lines changed: 127 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,127 @@
1+
---
2+
authors: [boegel]
3+
date: 2025-02-10
4+
slug: integration-efp
5+
---
6+
7+
# Integration in the EuroHPC Federation Platform
8+
9+
A couple of weeks ago the EuroHPC Joint Undertaking (EuroHPC JU) [announced the consortium that will develop the
10+
**EuroHPC Federation Platform (EFP)**](https://eurohpc-ju.europa.eu/paving-way-eurohpc-federation-platform-2024-12-19_en).
11+
12+
This ambitious effort will deliver a 'one-stop shop' for researchers using the EuroHPC supercomputers,
13+
as well as the upcoming EuroHPC AI Factories and quantum computers, built with open source software.
14+
15+
<figure markdown="span">
16+
![EuroHPC JU logo](eurohpc-ju-logo.webp){width=70%}
17+
</figure>
18+
19+
Ghent University is part of this consortium to **integrate EESSI into the EuroHPC Federation Platform** as common software stack.
20+
21+
Henrik Nortamo (CSC), the technical lead of the EFP consortium, gave an excellent 20-minute talk on EFP
22+
last weekend in the 10th *HPC, Big Data, and Data Science* devroom at FOSDEM'25 in Brussels.
23+
**Slides and recording of the talk are available [here](https://fosdem.org/2025/schedule/event/fosdem-2025-6718-eurohpc-fp-a-federated-platform-for-hpc-infrastructure-in-europe-built-with-open-source-software/).**
24+
25+
<!-- more -->
26+
27+
28+
## The EFP consortium
29+
30+
The consortium that will develop the EuroHPC Federation Platform consists of:
31+
32+
* [CSC](https://csc.fi/en) in Finland, the Hosting Entity for [LUMI](https://www.lumi-supercomputer.eu), as lead partner;
33+
* [IT4Innovations](https://www.it4i.cz/en) in Czech Republic, the Hosting Entitory for [Karolina](https://www.it4i.cz/en/infrastructure/karolina);
34+
* [Ghent University](https://www.ugent.be/en) in Belgium;
35+
* [University of Tartu](https://ut.ee/en) in Estonia;
36+
* [GÉANT](https://geant.org), the pan-European data network for the research and education community;
37+
* [NORDUnet](https://www.nordu.net), a Nordic collaboration connecting national research and education network;
38+
39+
<figure markdown="span">
40+
![EuroHPC JU logo](EFP-group-picture-kickoff-meeting-20250117.webp){width=100%}
41+
</figure>
42+
43+
A productive kickoff meeting was held on 16+17 January 2025 in Helsinki, Finland.
44+
45+
Each of the components of the federated platform were presented by and to the consortium partners,
46+
and practical aspects of executing the planned work in the coming months and years were discussed.
47+
48+
## Scope and timeline of EFP
49+
50+
The federated platform aims to facilitate access to and usage of the EuroHPC infrastructure.
51+
52+
It will provide:
53+
54+
* Federated Single-Sign-On, based on [MyAccessID](https://wiki.geant.org/display/MyAccessID);
55+
* Direct access using (short-lived) SSH certificates;
56+
* Web interface for interactive use, based on [Open OnDemand](https://openondemand.org);
57+
* Common software stack, based on [EESSI](https://eessi.io);
58+
* Resource allocation and management across systems, based on [Waldur](https://waldur.com);
59+
* Advanced workflows and data transfer, based on [LEXIS](https://docs.lexis.tech/) and [HEAppE](https://heappe.eu/);
60+
61+
<figure markdown="span">
62+
![EuroHPC JU logo](EFP-architecture-20250202.webp){width=100%}
63+
</figure>
64+
65+
The development of the federated platform started just a couple of weeks ago (January 2025).
66+
An initial production version of the platform with currently online EuroHPC JU systems integrated
67+
is planned to be operational by March 2026.
68+
69+
The work is funded by the EuroHPC Joint Undertaking, who is providing a total budget of ~20 million Euro
70+
to the EFP consortium for 2025-2029.
71+
72+
73+
## Powered by open source software
74+
75+
<figure markdown="span">
76+
![EuroHPC JU logo](EFP-Henrik-FOSDEM-20250202.webp){width=100%}
77+
</figure>
78+
79+
!!! quote "Quote by Henrik Nortamo (CSC.fi), technical lead of EFP @ HPC devroom at FOSDEM'25"
80+
81+
***This would not be possible without open source.***
82+
83+
*If you consider the scope of the functionality, and the implicit understanding
84+
the implemented technologies have of user requirements, starting from scratch and
85+
compiling that into something sensible would be an *extremely* large job.*
86+
87+
*Federation requires of course a degree of trust that our stuff works.
88+
With open source, somebody else is running it, you can have a look at it, you can go and check it out.
89+
It's much easier than going "here's my binary blob, please install it so that stuff works".*
90+
91+
*Also on the promised features: I've shown you a bunch of stuff, I'm promising you many things
92+
which can be done. If this was a closed-source solution, which wasn't used anywhere
93+
and you couldn't look into it, you would probably think that "he's trying to bullshit us, there's no way".
94+
But now you know: yes, that is an open source component, it works there, I understand why it works,
95+
this could also work.*
96+
97+
[(see also slides + recording of Henrik's talk on EuroHPC Federation Platform)](https://fosdem.org/2025/schedule/event/fosdem-2025-6718-eurohpc-fp-a-federated-platform-for-hpc-infrastructure-in-europe-built-with-open-source-software/)
98+
99+
100+
## EESSI as common software stack
101+
102+
<figure markdown="span">
103+
![EESSI logo](EESSI-logo.webp){width=70%}
104+
</figure>
105+
106+
[EESSI](https://eessi.io/docs) will be integrated in the EuroHPC Federation Platform as a part of
107+
the *Federated Software Catalogue* component, a common software stack that will be available on the EuroHPC systems.
108+
109+
Researchers will be able to consult which software is available on the various EuroHPC systems through
110+
the *Federated Software Listing* component of the federated platform.
111+
112+
113+
## Current status of EESSI on EuroHPC JU systems
114+
115+
This work will foster a quick(er) and broad adoption of EESSI on EuroHPC infrastructure.
116+
117+
We expect that there will also be a "trickle-down" effect to national and local supercomputers
118+
throughout Europe (and beyond) to also make EESSI available there in the short term.
119+
120+
Today, EESSI is already available on various EuroHPC JU supercomputers,
121+
including Vega in Slovenia, Karolina in Czech Republic, and (the A64FX partition of) Deucalion in Portugal.
122+
123+
Discussions with various other EuroHPC JU systems to also make EESSI available there are ongoing, including
124+
MeluXina in Luxembourg, MareNostrum 5 in Spain, LUMI in Finland, and JUPITER in Germany.
125+
126+
An up-to-date overview of systems where EESSI is known to be available is available in the EESSI documentation:
127+
[https://eessi.io/docs/systems](https://www.eessi.io/docs/systems).
23 KB
Loading

0 commit comments

Comments
 (0)