You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/files/README.md
+19-17Lines changed: 19 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,11 +3,12 @@
3
3
Reviewed: 14.03.2024
4
4
5
5
# Introduction
6
+
6
7
In this article, we'll explore how to make a handy tool that helps to evaluate documents using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC).
7
8
This tool can be super useful in different situations:
8
-
For example, it could help recruiters in identifying the top nN% of resumes to get the best candidate for a job, as well it could help to check the RFP compliance in a vendor bid, or easily figure out what's in a bunch of email attachments without opening each one, but these are only few cases out of hundreads, you just name it. It can be applied to any industry, adaptable to any department like HR, Procurement, Marketing, Customer Service and others.
9
+
For example, it could help recruiters in identifying the top nN% of resumes to get the best candidate for a job, as well it could help to check the RFP compliance in a vendor bid, or easily figure out what's in a bunch of email attachments without opening each one, but these are only a few cases out of hundreds, you just name it. It can be applied to any industry and is adaptable to any department like HR, Procurement, Marketing, Customer Service, and others.
9
10
10
-
Here are just 2 examples on how you may use the document evaluation application:
11
+
Here are just 2 examples of how you may use the document evaluation application:
11
12
12
13
A CV Evaluation App as part of a recruitment process:
13
14
@@ -20,7 +21,8 @@ A Supplier Proposal Evaluation App as part of a vendor bid.
We've built the application using Oracle Visual Builder (as part of OIC), and it smoothly runs through Oracle Integration Cloud as the main, lowcode orchestration tool. OCI Document Understanding is there to handle the document processing, and Generative AI Multi-Chain Prompt technique for extracting key information from these CVs, summarizing them and help to facilitate the decisionmaking process:
41
+
We've built the application using Oracle Visual Builder (as part of OIC), and it smoothly runs through Oracle Integration Cloud as the main, low-code orchestration tool. OCI Document Understanding is there to handle the document processing, and Generative AI Multi-Chain Prompt technique for extracting key information from these CVs, summarizing them, and helping to facilitate the decision-making process:
40
42
41
43
1. Document Evaluation Tool App interface built using VBCS:
42
44
43
45
- The “CV Evaluation App” discussed in this context is crafted within the VBCS platform. Oracle Visual Builder Cloud Service serves as a hosted environment for building your application development infrastructure. It offers an open-source, standards-based development service for creating, collaborating on, and deploying applications within the Oracle Cloud.
44
46
45
47
2. Document Processing with OCI Document Understanding.:
46
-
- The role of OCI Document Understanding is to extract content from document images and other document file types, as CVs can be in different formats..
48
+
- The role of OCI Document Understanding is to extract content from document images and other document file types, as CVs can be in different formats.
47
49
- The service employs machine learning and optical character recognition capabilities(OCR) to analyze and extract information from various types of documents.
48
50
49
51
3. Key Criteria Extraction using OCI Generative AI Service:
50
-
- The extracted CV data from Document Understanding is sent to the OCI Generative AI Service to perform the following two tasks: CV Summarization and evaluation criteria extraction. This action is performed via one single prompt, that we will later explore in the section “Prompting with Oracle Generative AI”.
52
+
- The extracted CV data from Document Understanding is sent to the OCI Generative AI Service to perform the following two tasks: CV Summarization and evaluation criteria extraction. This action is performed via one single prompt, which we will later explore in the section “Prompting with Oracle Generative AI”.
51
53
52
54
4. Integration and orchestration using OIC:
53
-
- Oracle Integration Cloud adopts a low-code approach, allowing to create integrations and workflows with minimal coding effort and this accelerates the development process. OIC includes monitoring and analytics tools that provide real-time visibility into integration flows. This helps to track performance, identify bottlenecks, change and optimize LLM integration flows like the one we are exploring here.
55
+
- Oracle Integration Cloud adopts a low-code approach, allowing the creation of integrations and workflows with minimal coding effort and this accelerates the development process. OIC includes monitoring and analytics tools that provide real-time visibility into integration flows. This helps to track performance, identify bottlenecks, and change and optimize LLM integration flows like the one we are exploring here.
54
56
55
57
5. Document Evaluation using Generative AI:
56
58
- The decision-making process could be facilitated in this case with the help of Oracle Generative AI. We are using prompting techniques to help recruiters with useful information that they can use in the decision-making process.
@@ -61,7 +63,7 @@ We've built the application using Oracle Visual Builder (as part of OIC), and it
61
63
62
64
In this application:
63
65
64
-
**Step1.** The File Picker action in VBCS allows the Recruiter to upload all the CVs.
66
+
**Step1.** The File Picker action in VBCS allows the Recruiter to upload all the CVs.
**Step5.** At this step, using Generative AI the summary of the CV is created and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
91
+
**Step5.** At this step, using Generative AI the summary of the CV is created, and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, in order to obtain one of the response “Good Fit”/ “No Fit”
100
+
**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to Generative AI Inference REST API, to obtain one of the responses “Good Fit”/ “No Fit”
**Step7.** The list of all candidates is shown on the screen together with the response if the canditate is a good fit or not. Also a summary of each CV is available.
105
+
**Step7.** The list of all candidates is shown on the screen together with the response if the candidate is a good fit or not. Also, a summary of each CV is available.
In the following CV Evaluation APP usecase we are using a Generative AI Multi-Chain Prompting technique in order to get the results. It consists of 2 prompts:
111
+
In the following CV Evaluation APP use case we are using a Generative AI Multi-Chain Prompting technique to get the results. It consists of 2 prompts:
110
112
111
113
**Important Note:**
112
114
**All examples and data presented in this article are purely fictive and for showcasing purposes only. Any resemblance to real persons, or actual companies is purely coincidental. Dummy users and entities have been created for this demo, and no real data or information about individuals or organizations is being disclosed. We prioritize privacy and ethical considerations in the presentation of information, and any similarities to real-world entities are unintentional.**
113
115
114
-
## Prompt 1: Summarization and Key Criteria extraction
116
+
## Prompt 1: Summarization and Key Criteria Extraction
115
117
116
-
In order to extract the right skills from the CV that matches the Evaluator input, we have created a prompt in a Zero-shot technique, where we explicity mentioning the output we need to gather out of the document:
118
+
To extract the right skills from the CV that match the Evaluator input, we have created a prompt in a Zero-shot technique, where we explicitly mention the output we need to gather out of the document:
@@ -139,7 +141,7 @@ Please find the **document_evaluation_app_resources.zip** archive in <a href="./
139
141
140
142
# Conclusion
141
143
142
-
In conclusion, using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC) you may built a nice solution that may sort and help in evaluating documents across various industries and departments. It's adaptability and ease of use can become a handy tool for streamlining document management processes, saving time, and helping in enhancing productivity across a wide range of business scenarios.
144
+
In conclusion, using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC) you may build a nice solution that may sort and help in evaluating documents across various industries and departments. Its adaptability and ease of use can become a handy tool for streamlining document management processes, saving time, and helping enhance productivity across a wide range of business scenarios.
0 commit comments