Merge branch 'main' into gianniconte-OPAAssets

Author: MarcelStraka

ai-and-app-modernisation/ai-services/ai-document-understanding/README.md

@@ -25,6 +25,9 @@ Reviewed: 30.01.2024
 
 - [Cloud Coaching - Automating Invoice Handling using OIC and AI Document Understanding Service](https://www.youtube.com/watch?v=pjdQzFscOrk)
     - In this session, we demonstrate how you can use OCI AI Document Understanding service's pre-trained models to extract key information from invoices and use Oracle Integration Cloud to automate the whole process. It also includes kick-starting process workflows where human intervention is required.
+
+    - [Oracle AI Invoice Handling Solution](https://github.com/oracle-devrel/oci-ai-invoice-handling)
+
 - [Demo: Automate Invoice Handling - Oracle Integration Cloud & AI Document Understanding Service](https://youtu.be/k72CcNhmOjs)
 - [Smarter Apps with AI, OIC partner community webcast June 2023](https://videohub.oracle.com/media/Smarter+AI+Apps+with+OIC+partner+community+webcast+June+2023-1080p30/1_m2yjnvf9)
     - OCI Language and Document Understanding are cloud-based AI services for performing sophisticated text analysis and extracting data from all kinds of documents e.g. Passport, Driving License, Invoices, Receipts, etc. You can use these services to build intelligent applications by leveraging REST APIs. You can use these services to build intelligent applications by leveraging REST APIs and automating using Oracle Integration Cloud. This allows you to process unstructured text for use cases such as sentiment analysis, service ticket classification, document extraction, and more using pre-trained models or your own custom models leveraging OCI Data Labelling.

ai-and-app-modernisation/ai-services/generative-ai-service/README.md

@@ -49,6 +49,7 @@ Reviewed: 30.01.2024
 - [Oracle's Vision for the Future - Larry Ellison keynote Oracle Cloud World 2023](https://www.youtube.com/watch?v=63DmgBN1rSI)
 - [Generative AI on Oracle.com](https://www.oracle.com/artificial-intelligence/generative-ai/)
 - [Generative AI product documentation](https://docs.oracle.com/en-us/iaas/Content/generative-ai/home.htm)
+- [Live Lab to Search Documents stored in Object Storage using Opensearch, Generative AI, Semantic Search, RAG](https://apexapps.oracle.com/pls/apex/r/dbpm/livelabs/run-workshop?p210_wid=3762&p210_wec=&session=114913007746363)
 
 # License
 

ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/LICENSE

@@ -0,0 +1,35 @@
+Copyright (c) 2024 Oracle and/or its affiliates.
+
+The Universal Permissive License (UPL), Version 1.0
+
+Subject to the condition set forth below, permission is hereby granted to any
+person obtaining a copy of this software, associated documentation and/or data
+(collectively the "Software"), free of charge and under any and all copyright
+rights in the Software, and any and all patent rights owned or freely
+licensable by each licensor hereunder covering either (i) the unmodified
+Software as contributed to or provided by such licensor, or (ii) the Larger
+Works (as defined below), to deal in both
+
+(a) the Software, and
+(b) any piece of software and/or hardware listed in the lrgrwrks.txt file if
+one is included with the Software (each a "Larger Work" to which the Software
+is contributed by such licensors),
+
+without restriction, including without limitation the rights to copy, create
+derivative works of, display, perform, and distribute the Software and make,
+use, sell, offer for sale, import, export, have made, and have sold the
+Software and the Larger Work(s), and to sublicense the foregoing rights on
+either these or other terms.
+
+This license is subject to the following condition:
+The above copyright notice and either this complete permission notice or at
+a minimum a reference to the UPL must be included in all copies or
+substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/README.md

@@ -0,0 +1,23 @@
+# Document Evaluation Tool using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud
+
+In this article, we'll explore how to make a handy tool that helps to evaluate documents using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC). 
+This application combines a low-code approach to orchestrate LLM AI services and applications using Oracle Integration Cloud
+and Generative AI prompting techniques for tasks like document key criteria extraction, summarization, and evaluation.
+
+Reviewed: 14.03.2024
+ 
+# When to use this asset?
+ 
+See the README document in the /files folder.
+ 
+# How to use this asset?
+ 
+See the README document in the /files folder.
+ 
+# License
+ 
+Copyright (c) 2024 Oracle and/or its affiliates.
+ 
+Licensed under the Universal Permissive License (UPL), Version 1.0.
+ 
+See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.

ai-and-app-modernisation/ai-services/generative-ai-service/doc-evaluation-genai/files/README.md

@@ -0,0 +1,158 @@
+# Document Evaluation Tool using Oracle Generative AI, OCI Document Understanding and Oracle Integration Cloud
+
+Reviewed: 14.03.2024
+
+# Introduction
+
+In this article, we'll explore how to make a handy tool that helps to evaluate documents using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC). 
+This tool can be super useful in different situations:
+For example, it could help recruiters in identifying the top nN% of resumes to get the best candidate for a job, as well it could help to check the RFP compliance in a vendor bid, or easily figure out what's in a bunch of email attachments without opening each one, but these are only a few examples. It can be applied to any industry and is adaptable to any department like HR, Procurement, Marketing, Customer Service, and others.
+
+Here are 2 use cases for how you may use the document evaluation sample application:
+
+A CV Evaluation App as part of a recruitment process:
+
+<img src="./images/1_CVEvaluation.png"></img>
+<img src="./images/2_CVEvaluationResults.png"></img>
+
+
+A Supplier Proposal Evaluation App as part of a vendor bid.
+
+<img src="./images/3_RFPEvaluation.png"></img>
+<img src="./images/4_RFPEvaluationResults.png"></img>
+
+In this article we will use as a case study: **"CV Evaluation APP"**
+
+# Prerequisites
+
+Before getting started, make sure you have access to the following Oracle Cloud Infrastructure (OCI) services:
+
+- Oracle Generative AI Service (GenAI)
+- Oracle Document Understanding Service 
+- Oracle Integration Cloud (OIC) with Visual Builder(VBCS) enabled
+- Oracle Object Storage 
+
+
+# Solution Architecture
+
+In this section, we'll dive into the building blocks of the solution architecture.
+<img src="./images/5_SolutionArchitecture-oci-lowcode-ai-rag-logical-blocks.png"></img>
+
+We've built the application using Oracle Visual Builder (as part of OIC), and it smoothly runs through Oracle Integration Cloud  as the main, low-code orchestration tool. OCI Document Understanding is there to handle the document processing, and Generative AI Multi-Chain Prompt technique for extracting key information from these CVs, summarizing them, and helping to facilitate the decision-making process:
+
+1. Document Evaluation Tool App interface built using VBCS:
+
+- The “CV Evaluation App” discussed in this context is crafted within the VBCS platform. Oracle Visual Builder Cloud Service serves as a hosted environment for building your application development infrastructure. It offers an open-source, standards-based development service for creating, collaborating on, and deploying applications within the Oracle Cloud. 
+
+2. Document Processing with OCI Document Understanding.:
+- The role of OCI Document Understanding is to extract content from document images and other document file types, as CVs can be in different formats.
+- The service employs machine learning and optical character recognition capabilities(OCR) to analyze and extract information from various types of documents.
+
+3. Key Criteria Extraction using OCI Generative AI Service:
+- The extracted CV data from Document Understanding is sent to the OCI Generative AI Service to perform the following two tasks: CV Summarization and evaluation criteria extraction. This action is performed via one single prompt, which we will later explore in the section “Prompting with Oracle Generative AI”.
+
+4. Integration and orchestration using OIC:
+- Oracle Integration Cloud adopts a low-code approach, allowing the creation of integrations and workflows with minimal coding effort and this accelerates the development process. OIC includes monitoring and analytics tools that provide real-time visibility into integration flows. This helps to track performance, identify bottlenecks, and change and optimize LLM integration flows like the one we are exploring here.
+
+5. Document Evaluation using Generative AI:
+- The decision-making process could be facilitated in this case with the help of Oracle Generative AI. We are using prompting techniques to help recruiters with useful information that they can use in the decision-making process.
+
+
+
+# Application Flow in Detail
+
+In this application:
+
+**Step1.** The File Picker action in VBCS allows the Recruiter to upload all the CVs.
+
+<img src="./images/6_Step1VBCS_FilePicker.png"></img>
+
+<img src="./images/7_Step1VBCS_FilePicker2.png"></img>
+
+**Step2.** Evaluator select hard and soft criteria(input fields) from a predifined list.
+
+<img src="./images/8_Step2VBCS_CriteriaSelection.png"></img>
+
+**Step3.** Evaluator press the button “Evaluate”
+
+<img src="./images/9_Step3VBCS_Evaluation1.png"></img>
+<img src="./images/10_Step3VBCS_Evaluation2.png"></img>
+
+**Step4.** After pressing the button “Evaluate”, each CV is processed via  Document Understanding, triggering the **OIC Data Loader Low-Code Child Integration Flow** (CVs Data Extraction with Document Understanding REST API)
+
+<img src="./images/11_Step4OIC_DataLoader.png"></img>
+<img src="./images/12_Step4OIC_DataLoaderConfig.png"></img>
+<img src="./images/13_Step4OIC_DataLoaderRestInvoke.png"></img>
+<img src="./images/14_Step4OIC_DataLoaderSampleJson.png"></img>
+<img src="./images/15_Step4OIC_DataLoaderSapleJson2.png"></img>
+<img src="./images/16_Step4OIC_DocUnderstanding.png"></img>
+
+
+**Step5.** At this step, using Generative AI the summary of the CV is created, and also evaluation criteria are extracted, triggering the **OIC Query Engine Low-Code Parent Integration Flow** (CV Summary Generation and Evaluation Criteria extraction with Generative AI Inference REST API).
+
+<img src="./images/17_Step5OIC_Summarization.png"></img>
+<img src="./images/18_Step5OIC_SummarizationProperties.png"></img>
+<img src="./images/19_Step5OIC_SummarizationJsonDetails1.png"></img>
+<img src="./images/20_Step5OIC_SummarizationJsonDetails2.png"></img>
+<img src="./images/21_Step5OIC_SummarizationJsonDetails3.png"></img>
+<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>
+
+**Step6.** Decision logic together with Evaluator Criteria and Extracted Criteria from the Candidate CV are sent to  Generative AI Inference REST API, to obtain one of the responses “Good Fit”/ “No Fit” 
+
+<img src="./images/23_Step6OIC_Evaluation.png"></img>
+<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>
+
+**Step7.** The list of all candidates is shown on the screen together with the response if the candidate is a good fit or not. Also, a summary of each CV is available.
+
+<img src="./images/25_Step6OIC_VBCSEvaluationResult.png"></img>
+
+# Prompting with Oracle Generative AI
+
+In the following CV Evaluation APP use case we are using a Generative AI Multi-Chain Prompting technique to get the results. It consists of 2 prompts:
+
+**Important Note:** 
+**All examples and data presented in this article are purely fictive and for showcasing purposes only. Any resemblance to real persons, or actual companies is purely coincidental. Dummy users and entities have been created for this demo, and no real data or information about individuals or organizations is being disclosed. We prioritize privacy and ethical considerations in the presentation of information, and any similarities to real-world entities are unintentional.**
+
+## Prompt 1: Summarization and Key Criteria Extraction
+
+To extract the right skills from the CV that match the Evaluator input, we have created a prompt in a Zero-shot technique, where we explicitly mention the output we need to gather out of the document:
+
+
+<img src="./images/22_Step5OIC_GenAIPrompt.png"></img>
+
+Please access the full prompt <a href="./images/CVEvaluationAppPrompts.pdf">here</a>
+
+## Prompt 2: Final candidate skills evaluation
+
+To evaluate all the CVs, a single prompt was built using two combined techniques: **Few-shot Prompting** and **Chain-of-Thought Prompting**.
+
+<img src="./images/24_Step6OIC_GenAIPrompt.png"></img>
+
+Please access the full prompt <a href="./images/CVEvaluationAppPrompts.pdf">here</a>
+
+# Code
+      VBCS app - RecruitmentApp-1.0.zip
+      OIC CV Summary Generation and Evaluation Criteria extraction Parent Integration Flow - CV_JOB_MATCH_FINDER_01.00.0000.iar
+      OIC CVs Data Extraction Child Integration Flow - AIDOCUMENTPROCESSING_01.00.0000.iar
+      Generative AI Prompts: CVEvaluationAppPrompts.pdf
+      CV Samples - cv_samples folder
+
+Please find the **document_evaluation_app_resources.zip** archive in <a href="./document_evaluation_app_resources.zip">/files/document_evaluation_app_resources.zip</a>
+
+# Conclusion
+
+In conclusion,  using Oracle Generative AI, OCI Document Understanding, and Oracle Integration Cloud (OIC)  you may build a nice solution that may  sort and help in evaluating documents across various industries and departments. Its adaptability and ease of use can become a handy tool for streamlining document management processes, saving time, and helping enhance productivity across a wide range of business scenarios.
+
+### Authors
+
+<a href="https://github.com/jcgocol">@jcgocol</a>, <a href="https://github.com/clemnaru">@clemnaru</a>
+
+
+# License
+ 
+Copyright (c) 2024 Oracle and/or its affiliates.
+ 
+Licensed under the Universal Permissive License (UPL), Version 1.0.
+ 
+See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
+