Skip to content

Commit 30bc01f

Browse files
authored
feat: Several fixes and campaign tools extensions (#150)
* Correct content layer handling. Signed-off-by: Christoph Auer <[email protected]> * More fixes Signed-off-by: Christoph Auer <[email protected]> * Add direct CVAT table metrics Signed-off-by: Christoph Auer <[email protected]> * Add missing file Signed-off-by: Christoph Auer <[email protected]> --------- Signed-off-by: Christoph Auer <[email protected]>
1 parent a6811c4 commit 30bc01f

File tree

9 files changed

+833
-106
lines changed

9 files changed

+833
-106
lines changed

docling_eval/campaign_tools/README_cvat_evaluation_pipeline.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,7 @@ python cvat_evaluation_pipeline.py <images_dir> <output_dir> [OPTIONS]
3838
- `--pred-xml PATH`: Path to prediction CVAT XML file
3939
- `--step {gt,pred,eval,full}`: Pipeline step to run (default: full)
4040
- `--modalities {layout,document_structure}`: Evaluation modalities to run (default: both)
41+
- `--strict`: Strict mode - require all images to have annotations in XML files (default: allow partial annotation batches)
4142
- `--verbose, -v`: Enable verbose logging
4243

4344
## Examples
@@ -104,6 +105,25 @@ python cvat_evaluation_pipeline.py \
104105
--modalities document_structure
105106
```
106107

108+
### 5. Strict Mode
109+
110+
By default, the pipeline allows partial annotation batches where not all images need to have annotations in the XML file. This is useful when you have a large set of images but only a subset has been annotated.
111+
112+
To enforce that ALL images must have annotations, use the `--strict` flag:
113+
114+
```bash
115+
python cvat_evaluation_pipeline.py \
116+
/path/to/images \
117+
/path/to/output \
118+
--gt-xml /path/to/complete_annotations.xml \
119+
--strict
120+
```
121+
122+
In strict mode:
123+
- The pipeline will fail with an error if any image lacks annotations
124+
- Useful for validating complete annotation batches
125+
- Helps catch missing annotations early in the process
126+
107127
## Output Structure
108128

109129
The pipeline creates the following directory structure in the output directory:

0 commit comments

Comments
 (0)