Skip to content

[SYSTEMDS-3780] Compression-fused Quantization#2259

Closed
Baunsgaard wants to merge 5 commits intoapache:mainfrom
Baunsgaard:MergeFusedCompQ
Closed

[SYSTEMDS-3780] Compression-fused Quantization#2259
Baunsgaard wants to merge 5 commits intoapache:mainfrom
Baunsgaard:MergeFusedCompQ

Conversation

@Baunsgaard
Copy link
Contributor

This commit adds a new fused operator that both quantize an input and compresses the result. The operator does not allocate the intermediate quantized matrix.

Closes #2226

@codecov
Copy link

codecov bot commented May 13, 2025

Codecov Report

Attention: Patch coverage is 58.33333% with 290 lines in your changes missing coverage. Please review.

Project coverage is 72.65%. Comparing base (9e649c8) to head (3ab5660).
Report is 11 commits behind head on main.

Files with missing lines Patch % Lines
...sds/runtime/compress/colgroup/ColGroupFactory.java 39.07% 81 Missing and 11 partials ⚠️
...ntime/compress/estim/encoding/EncodingFactory.java 58.23% 54 Missing and 17 partials ⚠️
...e/sysds/runtime/compress/bitmap/BitmapEncoder.java 46.91% 38 Missing and 5 partials ⚠️
...untime/compress/colgroup/ColGroupUncompressed.java 25.00% 26 Missing and 7 partials ⚠️
...apache/sysds/parser/BuiltinFunctionExpression.java 0.00% 18 Missing ⚠️
...time/instructions/cp/CompressionCPInstruction.java 76.00% 5 Missing and 7 partials ⚠️
...untime/compress/readers/ReaderColumnSelection.java 33.33% 5 Missing and 5 partials ⚠️
...s/rewrite/RewriteQuantizationFusedCompression.java 79.54% 5 Missing and 4 partials ⚠️
...in/java/org/apache/sysds/parser/DMLTranslator.java 0.00% 2 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##               main    #2259      +/-   ##
============================================
- Coverage     72.71%   72.65%   -0.06%     
- Complexity    45817    45903      +86     
============================================
  Files          1474     1476       +2     
  Lines        171934   172455     +521     
  Branches      33601    33760     +159     
============================================
+ Hits         125021   125300     +279     
- Misses        37471    37656     +185     
- Partials       9442     9499      +57     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

anuunchin and others added 3 commits May 13, 2025 11:24
This commit adds a new fused operator that both quantize an input and
compresses the result. The operator does not allocate the intermediate
quantized matrix.

Closes apache#2226
@github-project-automation github-project-automation bot moved this from In Progress to Done in SystemDS PR Queue May 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants