Skip to content

Commit 90cb114

Browse files
Update README.md
spellchecking
1 parent 5755e17 commit 90cb114

File tree

1 file changed

+19
-17
lines changed
  • ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/files

1 file changed

+19
-17
lines changed

ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/files/README.md

Lines changed: 19 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -3,11 +3,12 @@
33
Reviewed: 14.03.2024
44

55
# Introduction
6+
67
In this article, we'll explore how to make a handy tool that helps to evaluate documents using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC).
78
This tool can be super useful in different situations:
8-
For example, it could help recruiters in identifying the top nN% of resumes to get the best candidate for a job, as well it could help to check the RFP compliance in a vendor bid, or easily figure out what's in a bunch of email attachments without opening each one, but these are only few cases out of hundreads, you just name it. It can be applied to any industry, adaptable to any department like HR, Procurement, Marketing, Customer Service and others.
9+
For example, it could help recruiters in identifying the top nN% of resumes to get the best candidate for a job, as well it could help to check the RFP compliance in a vendor bid, or easily figure out what's in a bunch of email attachments without opening each one, but these are only a few cases out of hundreds, you just name it. It can be applied to any industry and is adaptable to any department like HR, Procurement, Marketing, Customer Service, and others.
910

10-
Here are just 2 examples on how you may use the document evaluation application :
11+
Here are just 2 examples of how you may use the document evaluation application:
1112

1213
A CV Evaluation App as part of a recruitment process:
1314

@@ -20,7 +21,8 @@ A Supplier Proposal Evaluation App as part of a vendor bid.
2021
<img src="./images/3_RFPEvaluation.png"></img>
2122
<img src="./images/4_RFPEvaluationResults.png"></img>
2223

23-
In this Article we will use as a case study: **“CV Evaluation APP”**
24+
In this article we will use as a case study: **"CV Evaluation APP"**
25+
2426
# Prerequisites
2527

2628
Before getting started, make sure you have access to the following Oracle Cloud Infrastructure (OCI) services:
@@ -33,24 +35,24 @@ Before getting started, make sure you have access to the following Oracle Cloud
3335

3436
# Solution Architecture
3537

36-
In this section, we'll dive into the building bocks of the solution architecture.
38+
In this section, we'll dive into the building blocks of the solution architecture.
3739
<img src="./images/5_SolutionArchitecture-oci-lowcode-ai-rag-logical-blocks.png"></img>
3840

39-
We've built the application using Oracle Visual Builder (as part of OIC), and it smoothly runs through Oracle Integration Cloud as the main, low code orchestration tool. OCI Document Understanding is there to handle the document processing, and Generative AI Multi-Chain Prompt technique for extracting key information from these CVs, summarizing them and help to facilitate the decision making process:
41+
We've built the application using Oracle Visual Builder (as part of OIC), and it smoothly runs through Oracle Integration Cloud as the main, low-code orchestration tool. OCI Document Understanding is there to handle the document processing, and Generative AI Multi-Chain Prompt technique for extracting key information from these CVs, summarizing them, and helping to facilitate the decision-making process:
4042

4143
1. Document Evaluation Tool App interface built using VBCS:
4244

4345
- The “CV Evaluation App” discussed in this context is crafted within the VBCS platform. Oracle Visual Builder Cloud Service serves as a hosted environment for building your application development infrastructure. It offers an open-source, standards-based development service for creating, collaborating on, and deploying applications within the Oracle Cloud.
4446

4547
2. Document Processing with OCI Document Understanding.:
46-
- The role of OCI Document Understanding is to extract content from document images and other document file types, as CVs can be in different formats..
48+
- The role of OCI Document Understanding is to extract content from document images and other document file types, as CVs can be in different formats.
4749
- The service employs machine learning and optical character recognition capabilities(OCR) to analyze and extract information from various types of documents.
4850

4951
3. Key Criteria Extraction using OCI Generative AI Service:
50-
- The extracted CV data from Document Understanding is sent to the OCI Generative AI Service to perform the following two tasks: CV Summarization and evaluation criteria extraction. This action is performed via one single prompt, that we will later explore in the section “Prompting with Oracle Generative AI”.
52+
- The extracted CV data from Document Understanding is sent to the OCI Generative AI Service to perform the following two tasks: CV Summarization and evaluation criteria extraction. This action is performed via one single prompt, which we will later explore in the section “Prompting with Oracle Generative AI”.
5153

5254
4. Integration and orchestration using OIC:
53-
- Oracle Integration Cloud adopts a low-code approach, allowing to create integrations and workflows with minimal coding effort and this accelerates the development process. OIC includes monitoring and analytics tools that provide real-time visibility into integration flows. This helps to track performance, identify bottlenecks, change and optimize LLM integration flows like the one we are exploring here.
55+
- Oracle Integration Cloud adopts a low-code approach, allowing the creation of integrations and workflows with minimal coding effort and this accelerates the development process. OIC includes monitoring and analytics tools that provide real-time visibility into integration flows. This helps to track performance, identify bottlenecks, and change and optimize LLM integration flows like the one we are exploring here.
5456

5557
5. Document Evaluation using Generative AI:
5658
- The decision-making process could be facilitated in this case with the help of Oracle Generative AI. We are using prompting techniques to help recruiters with useful information that they can use in the decision-making process.
@@ -61,7 +63,7 @@ We've built the application using Oracle Visual Builder (as part of OIC), and it
6163

6264
In this application:
6365

64-
**Step1.** The File Picker action in VBCS allows the Recruiter to upload all the CVs .
66+
**Step1.** The File Picker action in VBCS allows the Recruiter to upload all the CVs.
6567

6668
<img src="./images/6_Step1VBCS_FilePicker.png"></img>
6769

@@ -86,7 +88,7 @@ In this application:
8688
<img src="./images/16_Step4OIC_DocUnderstanding.png"></img>
8789

8890

89-
**Step5.** At this step, using Generative AI the summary of the CV is created and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
91+
**Step5.** At this step, using Generative AI the summary of the CV is created, and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
9092

9193
<img src="./images/17_Step5OIC_Summarization.png"></img>
9294
<img src="./images/18_Step5OIC_SummarizationProperties.png"></img>
@@ -95,25 +97,25 @@ In this application:
9597
<img src="./images/21_Step5OIC_SummarizationJsonDetails3.png"></img>
9698
<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>
9799

98-
**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, in order to obtain one of the response “Good Fit”/ “No Fit”
100+
**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, to obtain one of the responses “Good Fit”/ “No Fit”
99101

100102
<img src="./images/23_Step6OIC_Evaluation.png"></img>
101103
<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>
102104

103-
**Step7.** The list of all candidates is shown on the screen together with the response if the canditate is a good fit or not. Also a summary of each CV is available.
105+
**Step7.** The list of all candidates is shown on the screen together with the response if the candidate is a good fit or not. Also, a summary of each CV is available.
104106

105107
<img src="./images/25_Step6OIC_VBCSEvaluationResult.png"></img>
106108

107109
# Prompting with Oracle Generative AI
108110

109-
In the following CV Evaluation APP usecase we are using a Generative AI Multi-Chain Prompting technique in order to get the results. It consists of 2 prompts:
111+
In the following CV Evaluation APP use case we are using a Generative AI Multi-Chain Prompting technique to get the results. It consists of 2 prompts:
110112

111113
**Important Note:**
112114
**All examples and data presented in this article are purely fictive and for showcasing purposes only. Any resemblance to real persons, or actual companies is purely coincidental. Dummy users and entities have been created for this demo, and no real data or information about individuals or organizations is being disclosed. We prioritize privacy and ethical considerations in the presentation of information, and any similarities to real-world entities are unintentional.**
113115

114-
## Prompt 1: Summarization and Key Criteria extraction
116+
## Prompt 1: Summarization and Key Criteria Extraction
115117

116-
In order to extract the right skills from the CV that matches the Evaluator input, we have created a prompt in a Zero-shot technique, where we explicity mentioning the output we need to gather out of the document:
118+
To extract the right skills from the CV that match the Evaluator input, we have created a prompt in a Zero-shot technique, where we explicitly mention the output we need to gather out of the document:
117119

118120

119121
<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>
@@ -122,7 +124,7 @@ Please access the full prompt <a href="./images/CVEvaluationAppPrompts.pdf">here
122124

123125
## Prompt 2: Final candidate skills evaluation
124126

125-
In order to evaluate all the CVs, a single prompt was build using two combined techniques: **Few-shot Prompting** and **Chain-of-Thought Prompting**.
127+
To evaluate all the CVs, a single prompt was built using two combined techniques: **Few-shot Prompting** and **Chain-of-Thought Prompting**.
126128

127129
<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>
128130

@@ -139,7 +141,7 @@ Please find the **document_evaluation_app_resources.zip** archive in <a href="./
139141

140142
# Conclusion
141143

142-
In conclusion, using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC) you may built a nice solution that may sort and help in evaluating documents across various industries and departments. It's adaptability and ease of use can become a handy tool for streamlining document management processes, saving time, and helping in enhancing productivity across a wide range of business scenarios.
144+
In conclusion, using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC) you may build a nice solution that may sort and help in evaluating documents across various industries and departments. Its adaptability and ease of use can become a handy tool for streamlining document management processes, saving time, and helping enhance productivity across a wide range of business scenarios.
143145

144146
### Authors
145147

0 commit comments

Comments
 (0)