Skip to content

Commit 4a414c0

Browse files
committed
Release v0.2.3: Fix hybrid importance calculation
1 parent 21fb579 commit 4a414c0

File tree

3 files changed

+31
-2
lines changed

3 files changed

+31
-2
lines changed

CHANGELOG.md

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,32 @@
1+
## [0.2.3] - 2025-12-04
2+
3+
### 🐛 Bug Fixes
4+
5+
#### Fixed Hybrid Importance Calculation
6+
- **compute_neuron_pair_importance_maw_hybrid()**: Simplified and fixed fórmula for hybrid importance calculation
7+
- **Improved Accuracy**: Now correctly combines static weight magnitudes with dynamic activation statistics
8+
- **Better Performance**: Reduced unnecessary calculations while maintaining correctness
9+
- **Consistent Methodology**: Uses MAW (Maximum Absolute Weight) consistently across all MLP components
10+
- **No API Changes**: Fully backward compatible, internal optimization only
11+
12+
### 🔧 Technical Details
13+
14+
#### Fixed Functions
15+
- `compute_neuron_pair_importance_maw_hybrid()`: Corrected importance score calculation:
16+
- Static Component: Uses MAW (max + |min|) for gate_proj and up_proj layers
17+
- Normalization: Scales each component to [0,1] for balanced weighting
18+
- Hybrid Fusion: Multiplies structural potential by activation norms
19+
- Validation: All tests pass, no breaking changes
20+
21+
### 🔒 Compatibility
22+
23+
- Fully backward compatible with v0.2.2 and earlier
24+
- No changes to public API
25+
- No changes to function signatures
26+
- Internal optimization only
27+
28+
---
29+
130
## [0.2.2] - 2025-11-26
231

332
### 🎉 New Features

optipfair/__init__.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@
1414

1515
from .pruning.utils import get_pruning_statistics
1616

17-
__version__ = "0.2.2"
17+
__version__ = "0.2.3"
1818

1919
# Configure logging
2020
logging.basicConfig(

setup.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55

66
setup(
77
name="optipfair",
8-
version="0.2.2",
8+
version="0.2.3",
99
author="Pere Martra",
1010
author_email="peremartra@uadla.com",
1111
description="A library for structured pruning & Bias visualization of large language models",

0 commit comments

Comments
 (0)