Skip to content

Commit 375913e

Browse files
author
Bob Strahan
committed
Enable evaluation in config library samples
1 parent b7b44f0 commit 375913e

File tree

6 files changed

+7
-5
lines changed

6 files changed

+7
-5
lines changed

config_library/pattern-1/lending-package-sample/config.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,6 +67,7 @@ summarization:
6767
system_prompt: >-
6868
You are a document summarization expert who can analyze and summarize documents from various domains including medical, financial, legal, and general business documents. Your task is to create a summary that captures the key information, main points, and important details from the document. Your output must be in valid JSON format. \nSummarization Style: Balanced\\nCreate a balanced summary that provides a moderate level of detail. Include the main points and key supporting information, while maintaining the document's overall structure. Aim for a comprehensive yet concise summary.\n Your output MUST be in valid JSON format with markdown content. You MUST strictly adhere to the output format specified in the instructions.
6969
evaluation:
70+
enabled: true
7071
llm_method:
7172
top_p: '0.1'
7273
max_tokens: '4096'
@@ -520,4 +521,3 @@ pricing:
520521
units:
521522
- name: gb_seconds
522523
price: '1.66667E-5' # $0.0000166667 per GB-second ($16.67 per 1M GB-seconds)
523-

config_library/pattern-2/bank-statement-sample/config.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -529,6 +529,7 @@ assessment:
529529
</extraction-results>
530530
531531
evaluation:
532+
enabled: true
532533
llm_method:
533534
top_p: '0.1'
534535
max_tokens: '4096'
@@ -997,4 +998,3 @@ pricing:
997998
units:
998999
- name: gb_seconds
9991000
price: '1.66667E-5' # $0.0000166667 per GB-second ($16.67 per 1M GB-seconds)
1000-

config_library/pattern-2/lending-package-sample/config.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1307,6 +1307,7 @@ assessment:
13071307
{EXTRACTION_RESULTS}
13081308
</extraction-results>
13091309
evaluation:
1310+
enabled: true
13101311
llm_method:
13111312
top_p: "0.1"
13121313
max_tokens: "4096"
@@ -1776,4 +1777,3 @@ pricing:
17761777
units:
17771778
- name: gb_seconds
17781779
price: "1.66667E-5" # $0.0000166667 per GB-second ($16.67 per 1M GB-seconds)
1779-

config_library/pattern-2/rvl-cdip-package-sample-with-few-shot-examples/config.yaml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -957,6 +957,7 @@ assessment:
957957
{EXTRACTION_RESULTS}
958958
</extraction-results>
959959
evaluation:
960+
enabled: true
960961
llm_method:
961962
top_p: '0.1'
962963
max_tokens: '4096'
@@ -1509,4 +1510,4 @@ pricing:
15091510
- name: lambda/duration
15101511
units:
15111512
- name: gb_seconds
1512-
price: '1.66667E-5' # $0.0000166667 per GB-second ($16.67 per 1M GB-seconds)
1513+
price: '1.66667E-5' # $0.0000166667 per GB-second ($16.67 per 1M GB-seconds)

config_library/pattern-2/rvl-cdip-package-sample/config.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -766,6 +766,7 @@ assessment:
766766
{EXTRACTION_RESULTS}
767767
</extraction-results>
768768
evaluation:
769+
enabled: true
769770
llm_method:
770771
top_p: '0.1'
771772
max_tokens: '4096'
@@ -1235,4 +1236,3 @@ pricing:
12351236
units:
12361237
- name: gb_seconds
12371238
price: '1.66667E-5' # $0.0000166667 per GB-second ($16.67 per 1M GB-seconds)
1238-

config_library/pattern-3/rvl-cdip-package-sample/config.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -625,6 +625,7 @@ assessment:
625625
{EXTRACTION_RESULTS}
626626
</extraction-results>
627627
evaluation:
628+
enabled: true
628629
llm_method:
629630
top_p: '0.1'
630631
max_tokens: '4096'

0 commit comments

Comments
 (0)