Skip to content

fix: PixelLayoutEvaluator: Set all-pixels background in case of a missing prediction and evaluate#183

Merged
nikos-livathinos merged 7 commits intomainfrom
nli/pixel_missing_predictions
Dec 4, 2025
Merged

fix: PixelLayoutEvaluator: Set all-pixels background in case of a missing prediction and evaluate#183
nikos-livathinos merged 7 commits intomainfrom
nli/pixel_missing_predictions

Conversation

@nikos-livathinos
Copy link
Member

@nikos-livathinos nikos-livathinos commented Dec 4, 2025 •
edited
Loading

  • Fix the logic of PixelLayoutEvaluator in case of missing predictions: All pixels are set to Background and evaluated with MultiLabelConfusionMatrix.
  • Fix bug in the dataset pixel counter.
  • Add pixel counters for each page in the json report.
  • Add canva_a, canva_b benchmark names.

@nikos-livathinos
feat: Runtime optimizations for MultiLabelConfusionMatrix by compress…
d45ccba 
…ing the binary representation

given in the input of the compute_confusion_matrix().

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
@nikos-livathinos
chore: Add debug log message
38badca 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
@nikos-livathinos
Merge branch 'main' into nli/pixel_eval_optimisations
398e52e
@nikos-livathinos
feat: Introduce the canva_a, canva_b benchmarks
9df320f 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
@nikos-livathinos
fix: Change the penalising logic in case of missing predictions
72d02b9 
Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
@nikos-livathinos
fix: PixelLayoutEvaluator: Set all-pixels background in case of a mis…
ec05bc2 
…sing prediction and evaluate.

Fix the sum of pixels for the entire dataset, add num_pixels in the report of each page.

Signed-off-by: Nikos Livathinos <nli@zurich.ibm.com>
@nikos-livathinos
Merge branch 'main' into nli/pixel_missing_predictions
c9ec1c2
@nikos-livathinos nikos-livathinos self-assigned this Dec 4, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Dec 4, 2025

✅ DCO Check Passed

Thanks @nikos-livathinos, all your commits are properly signed off. 🎉

@mergify
Copy link

mergify bot commented Dec 4, 2025

Merge Protections

Your pull request matches the following merge protections and will not be merged until they are valid.

🟢 Enforce conventional commit

Wonderful, this rule succeeded.

Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/

  • title ~= ^(fix|feat|docs|style|refactor|perf|test|build|ci|chore|revert)(?:\(.+\))?(!)?:

@nikos-livathinos nikos-livathinos merged commit 4314091 into main Dec 4, 2025
10 checks passed
@nikos-livathinos nikos-livathinos deleted the nli/pixel_missing_predictions branch December 4, 2025 16:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cau-git cau-git cau-git approved these changes

@PeterStaar-IBM PeterStaar-IBM Awaiting requested review from PeterStaar-IBM

Assignees

@nikos-livathinos nikos-livathinos

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@nikos-livathinos @cau-git