Skip to content

Commit 8b95a39

Browse files
authored
Merge branch 'main' into cristinaevaluation
2 parents 667eeb5 + 17639e5 commit 8b95a39

File tree

78 files changed

+10526
-242
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

78 files changed

+10526
-242
lines changed

ai-and-app-modernisation/ai-services/generative-ai-service/README.md

Lines changed: 6 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,6 @@
11
# Generative AI service
22

3-
Oracle’s AI strategy is to make artificial intelligence (AI) pervasive across its cloud
4-
applications and cloud infrastructure. We serve business users who want to
5-
improve business processes and outcomes through prebuilt AI capabilities, data
6-
scientists and developers who want complete control to build and deploy AI
7-
models of any kind, and independent software vendors (ISVs) who want the
8-
most performant and cost-effective platform to host their AI services.
3+
Oracle’s AI strategy is to make artificial intelligence (AI) pervasive across its cloud applications and cloud infrastructure. We serve business users who want to improve business processes and outcomes through prebuilt AI capabilities, data scientists and developers who want complete control to build and deploy AI models of any kind, and independent software vendors (ISVs) who want the most performant and cost-effective platform to host their AI services.
94

105
Reviewed: 30.01.2024
116

@@ -23,9 +18,9 @@ Reviewed: 30.01.2024
2318
- [Build a knowledge search solution by implementing Retrieval Augmented Generation with Generative AI](https://www.youtube.com/watch?v=lJptksR5omo&t=1530s)
2419
- [Gen AI-powered document search (Generative AI with custom UI)](https://youtu.be/vyJAZvYKY34)
2520
- [Enabling a WhatsApp Customer HelpMate using OCI Generative AI, AI-Language & Integration](https://youtu.be/ryo3wVB_69E?si=SxSuTVawoRcbhReU)
26-
- Use OCI Generative AI (in pre-availability) for "Customer Service Quick Replies" Generation for Whatsapp Neutral Messages (customer questions, queries, etc.), sentence-level sentiment analysis from OCI AI Language to uncover overall sentiment and set service ticket severity for negative Whatsapp messages, automatically classify Customer Service tickets through OCI AI Language custom text classification and aspect-based sentiment analysis (ABSA) services
21+
- Use OCI Generative AI (in pre-availability) for "Customer Service Quick Replies" Generation for Whatsapp Neutral Messages (customer questions, queries, etc.), sentence-level sentiment analysis from OCI AI-Language to uncover overall sentiment and set service ticket severity for negative Whatsapp messages, automatically classify Customer Service tickets through OCI AI-Language custom text classification and aspect-based sentiment analysis (ABSA) services
2722
- Learn how Oracle Integration Cloud and Oracle Cloud Infrastructure (OCI) Streaming allow real-time capture of WhatsApp messages.
28-
- All this automation using OCI Generative AI and AI Language Services APIs orchestrated by Oracle Integration Cloud (using a no-code integration approach)
23+
- All this automation using OCI Generative AI and AI-Language Services APIs orchestrated by Oracle Integration Cloud (using a no-code integration approach)
2924
- [Deploy 3rd party generative AI models to OCI](https://docs.oracle.com/en/solutions/deploy-generative-ai-to-oci/index.html#GUID-5567B1F2-4733-4D9C-B4BE-5B5429CA8C02)
3025
- The reference architecture shows generative AI models deployed to an OCI GPU instance for image and text generation.
3126
- [Running 3rd party LLMs on OCI](https://github.com/oracle-devrel/oci-generative-ai)
@@ -37,11 +32,14 @@ Reviewed: 30.01.2024
3732

3833
# Useful Links
3934

35+
- [Navigating the frontier: Key considerations for developing a generative AI integration strategy for the enterprise](https://blogs.oracle.com/ai-and-datascience/post/considerations-generative-ai-integration-strategy)
4036
- [The Future of Generative AI: What Enterprises Need to Know](https://blogs.oracle.com/ai-and-datascience/post/future-generative-ai-what-enterprises-need-to-know)
4137
- [Announcing the general availability of OCI Generative AI](https://blogs.oracle.com/ai-and-datascience/post/ga-oci-generative-ai)
4238
- [Oracle Embeds Generative AI Across the Technology Stack to Enable Enterprise AI Adoption at Scale](https://www.oracle.com/news/announcement/oracle-announces-availability-oci-generative-ai-service-2024-01-23/)
4339
- [Implement Oracle Cloud Infrastructure Generative AI based on Cohere Large Language Model - Blog & Architecture](https://docs.oracle.com/en/solutions/oci-generative-ai-llm/index.html#GUID-76987F35-F646-40CF-9CF2-42724BA57191)
4440
- [Generative AI Chatbot using LLaMA-2, Qdrant, RAG, LangChain & Streamlit](https://blogs.oracle.com/ai-and-datascience/post/ai-chatbot-llama2-qdrant-rag-langchain-streamlit)
41+
- [Developing AI applications with OCI Generative AI and LangChain](https://blogs.oracle.com/ai-and-datascience/post/developing-ai-apps-oci-generative-ai-langchain)
42+
- [Guide to prompt engineering: Translating natural language to SQL with Llama 2](https://blogs.oracle.com/ai-and-datascience/post/prompt-engineering-natural-language-sql-llama2)
4543
- [Oracle and Generative AI](https://docs.oracle.com/en-us/iaas/Content/Resources/Assets/whitepapers/oracle-and-generative-ai.pdf)
4644
- [Oracle’s generative AI strategy - blog by Greg Pavlik](https://blogs.oracle.com/ai-and-datascience/post/generative-ai-strategy)
4745
- [Oracle to Deliver Powerful and Secure Generative AI Services for Business](https://www.oracle.com/news/announcement/oracle-to-deliver-powerful-and-secure-generative-ai-service-for-business-2023-06-13/)
@@ -52,8 +50,6 @@ Reviewed: 30.01.2024
5250
- [Generative AI on Oracle.com](https://www.oracle.com/artificial-intelligence/generative-ai/)
5351
- [Generative AI product documentation](https://docs.oracle.com/en-us/iaas/Content/generative-ai/home.htm)
5452

55-
56-
5753
# License
5854

5955
Copyright (c) 2024 Oracle and/or its affiliates.
Lines changed: 12 additions & 76 deletions
Original file line numberDiff line numberDiff line change
@@ -1,85 +1,21 @@
1-
# Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder
2-
3-
# Introduction
4-
5-
OCI Speech is an AI service that applies automatic speech recognition technology to transform audio-based content into text. Generative AI, The Large Language Model (LLM) analyzes the text input and can generate, summarize, transform, and extract information. Using these AI capabilities, we built a low code application- “Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder " to invoke AI Speech REST API to convert audio files into text and then further invoke the Generative AI REST API to Summarize it.
1+
# Transcribe and summarize speech-to-text
2+
3+
OCI Speech is an AI service that applies automatic speech recognition technology to transform audio-based content into text. Generative AI, The Large Language Model (LLM) analyzes the text input and can generate, summarize, transform, and extract information. Using these AI capabilities, we built a low code application- “Integrate OCI AI Speech Service and Generative AI Service for Summarization in Visual Builder " to invoke AI Speech REST API to convert audio files into text and then further invoke the Generative AI REST API to Summarize it.
64

75
Reviewed: 20.02.2024
8-
9-
<img src="./files/AISpeechGenAISummary.png"></img>
10-
11-
# Prerequisites
12-
13-
Before getting started, make sure you have access to these services:
14-
15-
- Oracle Speech Service
16-
- Oracle Generative AI Service
17-
- Oracle Visual Builder Cloud Service
18-
- Oracle Visual Builder Service Connection
19-
20-
# AI Speech and OCI Generative AI Service Integration Architecture
21-
22-
1. AI Speech App using VBCS
23-
24-
- Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
25-
26-
2. Transcriptions with OCI AI Speech Service:
27-
- Speech harnesses the power of spoken language enabling you to easily convert media files containing human speech into highly exact text transcriptions.
28-
- Produces accurate and easy-to-use JSON and SubRip Subtitle (SRT) files written directly to the Object Storage bucket you choose.
29-
30-
3. Integration with OCI Generative AI Service:
31-
- The transcriptions (text) are sent to the OCI Generative AI Service for text summarization.
32-
33-
4. Integration with OCI AI Vision and OCI Generative AI Service using Visual Builder Service Endpoint:
34-
- Build a Service Connection Endpoint option is used to integrate the VBCS app and OCI Object Storage, OCI AI Speech Service, and Generative AI Summarization.
35-
36-
5. Summarization Process:
37-
- OCI Generative AI Service generates text using the keywords received from OCI Speech service, to create a concise summary of the audio or video.
38-
39-
40-
<img src="./files/AISpeechSummaryAppArch.svg"></img>
41-
42-
# Application Flow in Detail (VBCS, OCI Speech, OCI Generative AI Service)
43-
44-
In this application, the drag-and-drop component in VBCS allows the user to drop the audio or video.
45-
- Create a Service Endpoint connection in Visual Builder to handle the communication between Visual Builder and OCI Speech Service.
46-
- Pass the selected audio or video from Visual Builder to OCI Speech Service to convert it into text.
47-
- OCI Speech Service analyzes the media (audio or video) file and converts it into text.
48-
- The OCI Speech Service returns the transcription to the AI Speech Service Endpoint and returns the results to the Visual Builder app.
49-
- The transcription further passes to the Generative AI Service Endpoint and returns the Summarization results to the Visual Builder app.
50-
51-
User (Visual Builder) --> (Drag and Drop File) --> |Media File (adudio or video) --> (Service Endpoint) --> |OCI Speech Service| --> |Speech to Text| --> (Service Endpoint) --> |Result| --> (Visual Builder) --> (Gen AI Service Endpoint) --> |Result| --> (Visual Builder)
52-
53-
<img src="./files/AISpeechEngine.png"></img>
54-
55-
# Service Endpoint call - Invoke OCI Object Storage
56-
57-
uploadfile - /n/{namespaceName}/b/{bucketName}/o/{objectName}
58-
getObject - /n/{namespaceName}/b/{bucketName}/o/{outputFolderName}/{outputObjectName}
59-
60-
61-
# Service Endpoint call - Invoke AI Speech Service
62-
63-
create transcription - /transcriptionJobs
64-
get transcription - transcriptionJobs/{transcriptionJobId}
65-
66-
# Service Endpoint call - Invoke Generative AI Service
67-
68-
create summary - /20231130/actions/summarizeText
69-
70-
71-
# Conclusion
72-
73-
In this article, we've covered how to utilize Oracle AI Speech Service features to provide a transription and summarize using Generative AI service.
74-
75-
Feel free to modify and expand upon this template according to your specific use case and preferences.
76-
77-
6+
7+
# When to use this asset?
8+
9+
See the README document in the /files folder.
10+
11+
# How to use this asset?
12+
13+
See the README document in the /files folder.
14+
7815
# License
7916

8017
Copyright (c) 2024 Oracle and/or its affiliates.
8118

8219
Licensed under the Universal Permissive License (UPL), Version 1.0.
8320

8421
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
85-
Lines changed: 85 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,85 @@
1+
# Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder
2+
3+
# Introduction
4+
5+
OCI Speech is an AI service that applies automatic speech recognition technology to transform audio-based content into text. Generative AI, The Large Language Model (LLM) analyzes the text input and can generate, summarize, transform, and extract information. Using these AI capabilities, we built a low code application- "Integrate OCI AI Speech Service and Generative AI Summarization in Visual Builder" to invoke AI Speech REST API to convert audio files into text and then further invoke the Generative AI REST API to Summarize it.
6+
7+
Reviewed: 20.02.2024
8+
9+
<img src="./files/AISpeechGenAISummary.png"></img>
10+
11+
# Prerequisites
12+
13+
Before getting started, make sure you have access to these services:
14+
15+
- Oracle Speech Service
16+
- Oracle Generative AI Service
17+
- Oracle Visual Builder Cloud Service
18+
- Oracle Visual Builder Service Connection
19+
20+
# AI Speech and OCI Generative AI Service Integration Architecture
21+
22+
1. AI Speech App using VBCS
23+
24+
- Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
25+
26+
2. Transcriptions with OCI AI Speech Service:
27+
- Speech harnesses the power of spoken language enabling you to easily convert media files containing human speech into highly exact text transcriptions.
28+
- Produces accurate and easy-to-use JSON and SubRip Subtitle (SRT) files written directly to the Object Storage bucket you choose.
29+
30+
3. Integration with OCI Generative AI Service:
31+
- The transcriptions (text) are sent to the OCI Generative AI Service for text summarization.
32+
33+
4. Integration with OCI AI Vision and OCI Generative AI Service using Visual Builder Service Endpoint:
34+
- Build a Service Connection Endpoint option is used to integrate the VBCS app and OCI Object Storage, OCI AI Speech Service, and Generative AI Summarization.
35+
36+
5. Summarization Process:
37+
- OCI Generative AI Service generates text using the keywords received from OCI Speech service, to create a concise summary of the audio or video.
38+
39+
40+
<img src="./files/AISpeechSummaryAppArch.svg"></img>
41+
42+
# Application Flow in Detail (VBCS, OCI Speech, OCI Generative AI Service)
43+
44+
In this application, the drag-and-drop component in VBCS allows the user to drop the audio or video.
45+
- Create a Service Endpoint connection in Visual Builder to handle the communication between Visual Builder and OCI Speech Service.
46+
- Pass the selected audio or video from Visual Builder to OCI Speech Service to convert it into text.
47+
- OCI Speech Service analyzes the media (audio or video) file and converts it into text.
48+
- The OCI Speech Service returns the transcription to the AI Speech Service Endpoint and returns the results to the Visual Builder app.
49+
- The transcription further passes to the Generative AI Service Endpoint and returns the Summarization results to the Visual Builder app.
50+
51+
User (Visual Builder) --> (Drag and Drop File) --> |Media File (adudio or video) --> (Service Endpoint) --> |OCI Speech Service| --> |Speech to Text| --> (Service Endpoint) --> |Result| --> (Visual Builder) --> (Gen AI Service Endpoint) --> |Result| --> (Visual Builder)
52+
53+
<img src="./files/AISpeechEngine.png"></img>
54+
55+
# Service Endpoint call - Invoke OCI Object Storage
56+
57+
uploadfile - /n/{namespaceName}/b/{bucketName}/o/{objectName}
58+
getObject - /n/{namespaceName}/b/{bucketName}/o/{outputFolderName}/{outputObjectName}
59+
60+
61+
# Service Endpoint call - Invoke AI Speech Service
62+
63+
create transcription - /transcriptionJobs
64+
get transcription - transcriptionJobs/{transcriptionJobId}
65+
66+
# Service Endpoint call - Invoke Generative AI Service
67+
68+
create summary - /20231130/actions/summarizeText
69+
70+
71+
# Conclusion
72+
73+
In this article, we've covered how to utilize Oracle AI Speech Service features to provide a transcription and summarize using Generative AI service.
74+
75+
Feel free to modify and expand upon this template according to your specific use case and preferences.
76+
77+
78+
# License
79+
80+
Copyright (c) 2024 Oracle and/or its affiliates.
81+
82+
Licensed under the Universal Permissive License (UPL), Version 1.0.
83+
84+
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
85+

ai-and-app-modernisation/ai-services/generative-ai-service/summarize-genai/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@ Text summarization, a core NLP task, unlocks the ability to distill lengthy cont
44

55
In this article, we'll delve into the creation of a powerful document summarization solution leveraging Oracle Generative AI. Through the integration of Oracle Gen AI's advanced capabilities with cutting-edge technologies such as langchain. This codebase empowers users to effortlessly summarize extensive documents, harnessing the power of Oracle Generative AI Service.
66

7+
Reviewed: 11.03.2024
8+
79
<img src="./files/docSummarize.png">
810
</img>
911

0 commit comments

Comments
 (0)