Skip to content

Commit 7b1e62c

Browse files
committed
update demo assets so users can edit decision logic and evaluation examples from OIC VBCS UI
1 parent 32d21f2 commit 7b1e62c

23 files changed

+22
-9
lines changed

ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ In this article, we'll explore how to make a handy tool that helps to evaluate d
44
This application combines a low-code approach to orchestrate LLM AI services and applications using Oracle Integration Cloud
55
and Generative AI prompting techniques for tasks like document key criteria extraction, summarization, and evaluation.
66

7-
Reviewed: 14.03.2024
7+
Reviewed: 05.11.2024
88

99
# When to use this asset?
1010

ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/files/README.md

Lines changed: 21 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Document Evaluation Tool using Oracle Generative AI, OCI Document Understanding and Oracle Integration Cloud
22

3-
Reviewed: 14.03.2024
3+
Reviewed: 05.11.2024
44

55
# Introduction
66

@@ -14,12 +14,14 @@ A CV Evaluation App as part of a recruitment process:
1414

1515
<img src="./images/1_CVEvaluation.png"></img>
1616
<img src="./images/2_CVEvaluationResults.png"></img>
17+
<img src="./images/2_CVEvaluationResults_2.png"></img>
1718

1819

1920
A Supplier Proposal Evaluation App as part of a vendor bid.
2021

2122
<img src="./images/3_RFPEvaluation.png"></img>
2223
<img src="./images/4_RFPEvaluationResults.png"></img>
24+
<img src="./images/4_RFPEvaluationResults_2.png"></img>
2325

2426
In this article we will use as a case study: **"CV Evaluation APP"**
2527

@@ -73,12 +75,20 @@ In this application:
7375

7476
<img src="./images/8_Step2VBCS_CriteriaSelection.png"></img>
7577

76-
**Step3.** Evaluator press the button “Evaluate”
78+
**Step3.** Evaluator can edit the Decision Logic in Natural Language.
79+
80+
<img src="./images/8a_Step2VBCS_EvaluationMatrix.png"></img>
81+
82+
**Step4.** Evaluator can edit the Evaluation Examples in Natural Language.
83+
84+
<img src="./images/8b_Step2VBCS_EvaluationExamples.png"></img>
85+
86+
**Step5.** Evaluator press the button “Evaluate”
7787

7888
<img src="./images/9_Step3VBCS_Evaluation1.png"></img>
7989
<img src="./images/10_Step3VBCS_Evaluation2.png"></img>
8090

81-
**Step4.** After pressing the button “Evaluate”, each CV is processed via Document Understanding, triggering the **OIC Data Loader Low-Code Child Integration Flow** (CVs Data Extraction with Document Understanding REST API)
91+
**Step6.** After pressing the button “Evaluate”, each CV is processed via Document Understanding, triggering the **OIC Data Loader Low-Code Child Integration Flow** (CVs Data Extraction with Document Understanding REST API)
8292

8393
<img src="./images/11_Step4OIC_DataLoader.png"></img>
8494
<img src="./images/12_Step4OIC_DataLoaderConfig.png"></img>
@@ -88,7 +98,7 @@ In this application:
8898
<img src="./images/16_Step4OIC_DocUnderstanding.png"></img>
8999

90100

91-
**Step5.** At this step, using Generative AI the summary of the CV is created, and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
101+
**Step7.** At this step, using Generative AI the summary of the CV is created, and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
92102

93103
<img src="./images/17_Step5OIC_Summarization.png"></img>
94104
<img src="./images/18_Step5OIC_SummarizationProperties.png"></img>
@@ -97,14 +107,15 @@ In this application:
97107
<img src="./images/21_Step5OIC_SummarizationJsonDetails3.png"></img>
98108
<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>
99109

100-
**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, to obtain one of the responses “Good Fit”/ “No Fit”
110+
**Step8.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, to obtain one of the responses “Good Fit”/ “No Fit”
101111

102112
<img src="./images/23_Step6OIC_Evaluation.png"></img>
103113
<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>
104114

105-
**Step7.** The list of all candidates is shown on the screen together with the response if the candidate is a good fit or not. Also, a summary of each CV is available.
115+
**Step9.** The list of all candidates is shown on the screen together with the response if the candidate is a good fit or not. Also, a summary and a justification of the reasoning behind the evaluation result of each CV is available.
106116

107-
<img src="./images/25_Step6OIC_VBCSEvaluationResult.png"></img>
117+
<img src="./images/2_CVEvaluationResults.png"></img>
118+
<img src="./images/2_CVEvaluationResults_2.png"></img>
108119

109120
# Prompting with Oracle Generative AI
110121

@@ -132,8 +143,10 @@ Please access the full prompt <a href="./images/CVEvaluationAppPrompts.pdf">here
132143

133144
# Code
134145
VBCS app - RecruitmentApp-1.0.zip
135-
OIC CV Summary Generation and Evaluation Criteria extraction Parent Integration Flow - CV_JOB_MATCH_FINDER_01.00.0000.iar
146+
OIC CV Summary Generation and Evaluation Criteria extraction Parent Integration Flow - CV_EVALUATOR_01.00.0000.iar
136147
OIC CVs Data Extraction Child Integration Flow - AIDOCUMENTPROCESSING_01.00.0000.iar
148+
OIC Chat Completion Child Integration Flow - RESTCHATCOMPLETION_01.00.0000.iar
149+
OIC OCI Generative AI Chat Completion Child Integration Flow - RESTOCIGENERATIVECHATCOMPLETION_01.00.0000.iar
137150
Generative AI Prompts: CVEvaluationAppPrompts.pdf
138151
CV Samples - cv_samples folder
139152

255 KB
Loading
Loading
Loading
90.6 KB
Loading
Loading
Loading
470 KB
Loading

0 commit comments

Comments
 (0)