Skip to content

Commit 4c00071

Browse files
committed
new article by Sunitha
1 parent 1065f45 commit 4c00071

File tree

7 files changed

+88
-0
lines changed

7 files changed

+88
-0
lines changed
118 KB
Loading

ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/AIVisionAppArch.svg

Lines changed: 4 additions & 0 deletions
Loading
7.86 KB
Loading
16.3 KB
Loading
Lines changed: 84 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,84 @@
1+
# Summarize Image using OCI AI Vision Service and OCI Generative AI Service
2+
3+
## Introduction
4+
In this article, we'll explore how to summarize an image using OCI AI Vision Service and OCI Generative AI Service.
5+
The application is developed using Oracle VBCS, OIC , OCI AI Vision service and OCI Generative AI Service.
6+
This integrated approach combines the strengths of OCI AI Vision and OCI Generative AI Service, allowing for efficient and insightful summarization of image content.
7+
8+
<img src="./AIVisionApp.jpg>
9+
</img>
10+
11+
## Prerequisites
12+
13+
Before getting started, make sure you have the access to following services:
14+
15+
- Oracle Generative AI Service
16+
- Oracle Vision Service
17+
- Oracle Visual Builder Cloud Service
18+
- Oracle Integration Cloud
19+
20+
## AI Vision and OCI Generative AI Service Integration Architecture
21+
1. AI Vision App using VBCS
22+
o Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based integration to develop, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
23+
2. Image Analysis with OCI AI Vision Service:
24+
o The AI Vision service is employed to analyse images.
25+
o It identifies objects within the image using advanced computer vision algorithms.
26+
3. Integration with OCI Generative AI Service:
27+
o The extracted object keywords are sent to the OCI Generative AI Service
28+
4. Integration with OCI AI Vision and OCI Generative AI Service using OIC:
29+
o Oracle Integration Cloud is used to integrate VBCS app and OCI AI Services.
30+
5. Summarization Process:
31+
o OCI Generative AI Service generate text utilizes the received keywords from OCI Vision service to generate a concise summary of the image.
32+
33+
34+
<img src="./AIVisionAppArch.svg>
35+
</img>
36+
37+
## Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI)
38+
In this app,
39+
• The File Picker action in VBCS allow the user to select the image.
40+
• Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service.
41+
• Pass the selected image from VBCS to OCI Vision Service to analyse the image.
42+
• OCI Vision Service analyzes the image and identifies objects within it.
43+
• The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS.
44+
45+
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS)
46+
47+
<img src="./VBCS_Vision.jpg">
48+
</img>
49+
50+
OIC call - Invoke OCI Vision Service
51+
Endpoint - /actions/analyzeImage
52+
53+
<img src="./OIC_VisionService.jpg">
54+
</img>
55+
56+
• User clicks the "Generate" button in the app to initiate the summary generation.
57+
• Configure the OIC integration process to invoke the GenAI service.
58+
• Pass the keywords returned by the OCI Vision Service along with any additional relevant information.
59+
• GenAI service processes the received keywords and generates a summary of the image content.
60+
61+
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS)
62+
63+
<img src="./VBCS_GenerateSummary.jpg">
64+
</img>
65+
66+
OIC call - Invoke OCI Generative AI Service
67+
Endpoint - /20231130/actions/generatText
68+
<img src="./OIC_GenerateSummary.jpg">
69+
</img>
70+
71+
## Conclusion
72+
73+
In this article, we've covered how to utilise Oracle AI Vision Service features to provide summary of an image using Geneartive AI service .
74+
75+
Feel free to modify and expand upon this template according to your specific use case and preferences. Good luck with your article!
76+
77+
78+
# License
79+
80+
Copyright (c) 2024 Oracle and/or its affiliates.
81+
82+
Licensed under the Universal Permissive License (UPL), Version 1.0.
83+
84+
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
32.4 KB
Loading
11.1 KB
Loading

0 commit comments

Comments
 (0)