Skip to content

Commit 5119563

Browse files
ligerlacvvolkl
andauthored
New GSoC project proposal: Highly Granular Quantization for CICADA (#1668)
* Create proposal_HGQforCICADA.md * create princeton org (copy from 2023) * add CICADA project and logo * Update project proposal * Update proposal_HGQforCICADA.md * Update proposal_HGQforCICADA.md * typo Co-authored-by: Valentin Volkl <[email protected]> --------- Co-authored-by: Valentin Volkl <[email protected]>
1 parent ce9dee1 commit 5119563

File tree

4 files changed

+57
-0
lines changed

4 files changed

+57
-0
lines changed

_gsocorgs/2025/princeton.md

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
---
2+
title: "Princeton University"
3+
author: "Lino Gerlach"
4+
layout: default
5+
organization: princeton
6+
logo: princeton-logo.png
7+
description: |
8+
Princeton University is a private Ivy League research university in Princeton, New Jersey.
9+
---
10+
11+
{% include gsoc_proposal.ext %}
Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
---
2+
project: CICADA
3+
layout: default
4+
logo: cicada-logo.png
5+
description: |
6+
[CICADA](https://cicada.web.cern.ch/) Calorimeter Image Convolutional Anomaly Detection Algorithm (CICADA) uses low level Compact Muon Solenoid experiment's trigger calorimeter information as the input to convolutional autoencoder to find anomalies produced during Large Hadron Collider proton-proton collisionsis. Quantization Aware Training and Knowledge Distillation are used to compress the model for sub-500ns inference on Field-Programmable Gate Arrays.
7+
summary: |
8+
[CICADA](https://cicada.web.cern.ch/) Calorimeter Image Convolutional Anomaly Detection Algorithm: Real-time anomaly detection at CMS.
9+
---
10+
11+
{% include gsoc_project.ext %}
Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
---
2+
title: Highly Granular Quantization for CICADA
3+
layout: gsoc_proposal
4+
project: CICADA
5+
year: 2025
6+
organization: princeton
7+
---
8+
9+
## Description
10+
11+
The CICADA (Calorimeter Image Convolutional Anomaly Detection Algorithm) project aims to provide an unbiased detection of new physics signatures in proton-proton collisions at the Large Hadron Collider's Compact Muon Solenoid experiment (CMS). It detects anomalies in low-level trigger calorimeter information with a convolutional autoencoder, whose behaviour is transferred to a smaller model through knowledge distillation. Careful quantization of the deployed model allows it to meet the requirement of sub-500ns inference times on FPGAs. While CICADA currently employs Quantization Aware Training with different quantization schemes for each layer of the distilled model, a new gradient-based quantization optimization approach published in 2024 offers the possibility of optimizing quantization at the individual weight level. This project would explore implementing this highly granular quantization method to CICADA's distilled model and evaluating its effects on both model performance and resource consumption on FPGAs. The work would involve implementing the new quantization approach, comparing it with the current implementation, and investigating the impact on both detection performance and hardware resource utilization while maintaining the strict timing requirements.
12+
13+
## Task ideas
14+
* Transition CICADA's quantization tool from QKeras to HGQ
15+
* Optimize student model's quantization with higher granularity
16+
* Compare resulting model's performance with legacy model
17+
* Emulate deployment on FPGA w/ Vivado to evaluate resource consumption
18+
19+
## Expected results
20+
* Extend existing training / quantization scripts to use HGQ in addition to QKeras
21+
* A trained student model with highly granular quantization
22+
* Estimates of that model's performance and resource consumption on an FPGA
23+
24+
## Requirements
25+
Python, Tensorflow, Quantization
26+
27+
## Mentors
28+
* [Lino Gerlach](mailto:[email protected])
29+
* [Isobel Ojalvo](mailto:[email protected])
30+
31+
## Links
32+
* [CICADA (homepage)](https://cicada.web.cern.ch/)
33+
* [CICADA (code)](https://github.com/Princeton-AD/cicada)
34+
* [HGQ (Paper)](https://arxiv.org/pdf/2405.00645)
35+
* [HGQ (code)](https://github.com/calad0i/HGQ)

images/cicada-logo.png

106 KB
Loading

0 commit comments

Comments
 (0)