Skip to content

Commit cca53d1

Browse files
committed
feat: Add GSoC Proposal for TMVA SOFIE: Enhancing Keras Parser and JAX/FLAX Integration
1 parent 350cd03 commit cca53d1

File tree

1 file changed

+50
-0
lines changed

1 file changed

+50
-0
lines changed
Lines changed: 50 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,50 @@
1+
---
2+
title: TMVA SOFIE - Enhancing Keras Parser and JAX/FLAX Integration
3+
project: ROOT
4+
year: 2025
5+
organization: CERN
6+
difficulty: medium
7+
duration: 350
8+
mentor_avail: Flexible
9+
project_mentors:
10+
11+
organization: CERN
12+
first_name: Lorenzo
13+
last_name: Moneta
14+
is_preferred_contact: yes
15+
16+
organization: CERN
17+
first_name: Sanjiban
18+
last_name: Sengupta
19+
---
20+
21+
# Description
22+
SOFIE (System for Optimized Fast Inference code Emit) is a Machine Learning Inference Engine within TMVA (Toolkit for Multivariate Data Analysis) in ROOT. SOFIE offers a parser capable of converting ML models trained in Keras, PyTorch, or ONNX format into its own Intermediate Representation, and generates C++ functions that can be easily invoked for fast inference of trained neural networks. Using the IR, SOFIE can produce C++ header files that can be seamlessly included and used in a 'plug-and-go' style.
23+
24+
SOFIE currently supports various Machine Learning operators defined by the ONNX standards, as well as a Graph Neural Network (GNN) implementation. It supports the parsing and inference of Graph Neural Networks trained using DeepMind Graph Nets.
25+
26+
As SOFIE continues to evolve, this project aims to:
27+
* **Enhance the Keras parser** to support models trained in the latest TensorFlow v2.18.0, which introduces NumPy 2.0 compatibility.
28+
* **Integrate JAX/FLAX support**, enabling SOFIE to generate C++ inference functions for models developed using JAX/FLAX.
29+
30+
## Task ideas
31+
In this project, the contributor will gain experience with C++ and Python programming, TensorFlow/Keras and its storage formats for trained machine learning models, and JAX/FLAX for accelerated machine learning. They will begin by familiarizing themselves with SOFIE and its Keras parser. After researching the changes required to support the latest TensorFlow version, they will implement functionalities to ensure the successful generation of inference code for the latest Keras models. In the next phase, they will explore the JAX/FLAX library and investigate its potential integration with SOFIE.
32+
33+
## Expected results and milestones
34+
** **Familiarization with TMVA SOFIE**: Understand the SOFIE architecture, run inference using the existing Keras parser, and analyze the current parser's capabilities.
35+
* **Researching latest TensorFlow/Keras**: Investigate the latest TensorFlow/Keras developments and assess their alignment with SOFIE.
36+
* **Improving the Keras Parser**: Implement parser enhancements to support the latest TensorFlow version and validate inference results.
37+
* **JAX/FLAX Integration**: Design and develop a parsing mechanism for JAX/FLAX models, ensuring compatibility with SOFIE’s IR and further generation of inference code.
38+
39+
## Requirements
40+
* Proficiency in C++ and Python.
41+
* Knowledge of TensorFlow/Keras and JAX/FLAX.
42+
* Familiarity with version control systems like Git/GitHub.
43+
44+
## Links
45+
* [ROOT Project homepage](https://root.cern/)
46+
* [ROOT Project repository](https://github.com/root-project/root)
47+
* [SOFIE Repository](https://github.com/root-project/root/tree/master/tmva/sofie)
48+
* [Keras: The high-level API for TensorFlow](https://www.tensorflow.org/guide/keras)
49+
* [JAX Documentation](https://docs.jax.dev/en/latest/)
50+
* [FLAX Documentation](https://flax.readthedocs.io/en/latest/)

0 commit comments

Comments
 (0)