Skip to content

Commit 45edea3

Browse files
committed
Updating the labels.
1 parent 73f1a3d commit 45edea3

File tree

2 files changed

+2305
-3
lines changed

2 files changed

+2305
-3
lines changed

config_library/pattern-2/fcc-invoices/README.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -33,7 +33,7 @@ Sample documents are located in `samples/fcc-invoices/`:
3333
1. **AWS Credentials**: Valid AWS credentials with appropriate permissions
3434
2. **Python Environment**: Python 3.12+ with required packages
3535
3. **IDP CLI**: Installed and configured
36-
4. **Stickler**: Installed with `pip install -e "./stickler[dev]"`
36+
4. **Stickler**: Installed with `pip install stickler-eval`
3737
5. **Dependencies**: `pip install pandas`
3838

3939
## Step 1: Deploy the Stack
@@ -145,11 +145,13 @@ Evaluate the extraction results against ground truth:
145145
cd config_library/pattern-2/fcc-invoices
146146

147147
python bulk_evaluate_fcc_invoices.py \
148-
--results-dir ../../../fcc_results \
149-
--csv-path sr_refactor_labels_5_5_25.csv \
148+
--results-dir ../../../fcc_results/cli-batch-20251017-190516 \
149+
--csv-path sample_labels_3.csv \
150150
--output-dir evaluation_output
151151
```
152152

153+
**Note**: The `sample_labels_3.csv` contains ground truth for only 1 of the 3 sample documents. For full dataset evaluation, use `sr_refactor_labels_5_5_25.csv`.
154+
153155
**What this does:**
154156
- Loads ground truth labels from CSV
155157
- Matches documents by doc_id

0 commit comments

Comments
 (0)