File tree Expand file tree Collapse file tree 2 files changed +11
-9
lines changed
Expand file tree Collapse file tree 2 files changed +11
-9
lines changed Original file line number Diff line number Diff line change 11# OCR Comparison Pipeline Configuration
22
33# Image input configuration
4+ # image_paths and image_folder are combined if both are provided
45input :
5- image_paths : [] # List of specific image paths to process
6- image_folder : " assets/street_signs " # Folder containing images to process
6+ image_paths : ["assets/street_signs/montreal.jpg" ] # List of specific image paths to process
7+ image_folder : null # Folder containing images to process
78
89models :
9- custom_prompt : null # Optional custom prompt to use for both models
10- model1 : " llama3.2-vision:11b" # First model for comparison
11- model2 : " pixtral-12b-2409" # Second model for comparison
12- models :
13- - " llama3.2-vision:11b"
14- - " pixtral-12b-2409"
10+ custom_prompt : null # Optional custom prompt
11+ model1 : null # First model for comparison
12+ model2 : null # Second model for comparison
13+ models : # List of models to compare (takes precedence over model1 and model2)
14+ - mistral/pixtral-12b-2409
15+ - llama3.2-vision:11b
16+ - gemma3:27b
1517 ground_truth_model : " gpt-4o-mini" # Model to use for ground truth when source is "openai"
1618
1719ground_truth :
Original file line number Diff line number Diff line change @@ -120,7 +120,7 @@ def ocr_comparison_pipeline(
120120 elif ground_truth_source == "file" and ground_truth_file :
121121 ground_truth_df = load_ground_truth_file (filepath = ground_truth_file )
122122
123- gt_model_param = "gpt-4o-mini" if ground_truth_source == "openai" else None
123+ gt_model_param = ground_truth_model if ground_truth_source == "openai" else None
124124
125125 visualization = evaluate_models (
126126 model_results = model_results ,
You can’t perform that action at this time.
0 commit comments