[IcebergIO]: Compaction using sort-aware binpack planning

[ahmedabu98]

design doc: https://docs.google.com/document/d/1FXWNIwUAzkQ7ETAz5mnuwhgkkJ-YAGgvZWjTI4C-Fqo/edit

[github-actions]

This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the [email protected] list. Thank you for your contributions.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 54.90%. Comparing base (5565f38) to head (b4a7821).
⚠️ Report is 534 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff            @@
##             master   #36246   +/-   ##
=========================================
  Coverage     54.90%   54.90%           
  Complexity     1618     1618           
=========================================
  Files          1057     1057           
  Lines        164311   164311           
  Branches       1165     1165           
=========================================
  Hits          90219    90219           
  Misses        71939    71939           
  Partials       2153     2153           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.