Skip to content

Commit 44274b0

Browse files
clemnaruclemnaru
committed
Sunitha vision update with code
1 parent 5c89619 commit 44274b0

File tree

5 files changed

+90
-84
lines changed

5 files changed

+90
-84
lines changed

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/AIVisionAppArch.svg

Lines changed: 1 addition & 1 deletion
Loading

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/IMAGEDESCRIPTIONGENERATION_01.00.0000.iar

23.2 KB
Binary file not shown.

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/ImageClassification-1.0.zip

399 KB
Binary file not shown.

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/README.md

Lines changed: 89 additions & 83 deletions
Original file line numberDiff line numberDiff line change
@@ -1,83 +1,89 @@
1-
# Summarize Image using OCI AI Vision Service and OCI Generative AI Service
2-
3-
## Introduction
4-
In this article, we'll explore how to describe an image using OCI AI Vision Service and OCI Generative AI Service.
5-
The application is developed using Oracle VBCS, OIC , OCI AI Vision service and OCI Generative AI Service.
6-
This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for an efficient and insightful summarization of image content.
7-
8-
<img src="./AIVisionApp.jpg>
9-
</img>
10-
11-
## Prerequisites
12-
13-
Before getting started, make sure you have the access to these services:
14-
15-
- Oracle Generative AI Service
16-
- Oracle Vision Service
17-
- Oracle Visual Builder Cloud Service
18-
- Oracle Integration Cloud
19-
20-
## AI Vision and OCI Generative AI Service Integration Architecture
21-
1. AI Vision App using VBCS
22-
o Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
23-
2. Image Analysis with OCI AI Vision Service:
24-
o The AI Vision service is employed to analyse images.
25-
o It identifies objects within the image by using advanced computer vision algorithms.
26-
3. Integration with OCI Generative AI Service:
27-
o The extracted object keywords are sent to the OCI Generative AI Service
28-
4. Integration with OCI AI Vision and OCI Generative AI Service using OIC:
29-
o Oracle Integration Cloud is used to integrate VBCS app and OCI AI Services.
30-
5. Summarization Process:
31-
o OCI Generative AI Service generates text using the keywords received from OCI Vision service, to create a concise summary of the image.
32-
33-
34-
<img src="./AIVisionAppArch.svg>
35-
</img>
36-
37-
## Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI Service)
38-
In this application,
39-
• The File Picker action in VBCS allows the user to select the image.
40-
• Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service.
41-
• Pass the selected image from VBCS to OCI Vision Service to analyse the image.
42-
• OCI Vision Service analyzes the image and identifies objects within it.
43-
• The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS.
44-
45-
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS)
46-
47-
<img src="./VBCS_Vision.jpg">
48-
</img>
49-
50-
OIC call - Invoke OCI Vision Service
51-
Endpoint - /actions/analyzeImage
52-
53-
<img src="./OIC_VisionService.jpg">
54-
</img>
55-
56-
• User clicks the "Generate" button in the app to initiate the summary generation.
57-
• Configure the OIC integration process to invoke the GenAI service.
58-
• Pass the keywords returned by the OCI Vision Service along with any additional relevant information.
59-
• Generative AI Service processes the received keywords and generates a summary of the image content.
60-
61-
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS)
62-
63-
<img src="./VBCS_GenerateSummary.jpg">
64-
</img>
65-
66-
OIC call - Invoke OCI Generative AI Service
67-
Endpoint - /20231130/actions/generatText
68-
<img src="./OIC_GenerateSummary.jpg">
69-
</img>
70-
71-
## Conclusion
72-
73-
In this article, we've covered how to utilise Oracle AI Vision Service features to provide a summary of an image using Geneartive AI service .
74-
Feel free to modify and expand upon this template according to your specific use case and preferences.
75-
76-
77-
# License
78-
79-
Copyright (c) 2024 Oracle and/or its affiliates.
80-
81-
Licensed under the Universal Permissive License (UPL), Version 1.0.
82-
83-
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
1+
# Summarize Image using OCI AI Vision Service and OCI Generative AI Service
2+
3+
## Introduction
4+
In this article, we'll explore how to describe an image using OCI AI Vision Service and OCI Generative AI Service.
5+
The application is developed using Oracle VBCS, OIC , OCI AI Vision service and OCI Generative AI Service.
6+
This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for an efficient and insightful summarization of image content.
7+
8+
<img src="./AIVisionApp.jpg>
9+
</img>
10+
11+
## Prerequisites
12+
13+
Before getting started, make sure you have the access to these services:
14+
15+
- Oracle Generative AI Service
16+
- Oracle Vision Service
17+
- Oracle Visual Builder Cloud Service
18+
- Oracle Integration Cloud
19+
20+
## AI Vision and OCI Generative AI Service Integration Architecture
21+
1. AI Vision App using VBCS
22+
o Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS.
23+
2. Image Analysis with OCI AI Vision Service:
24+
o The AI Vision service is employed to analyse images.
25+
o It identifies objects within the image by using advanced computer vision algorithms.
26+
3. Integration with OCI Generative AI Service:
27+
o The extracted object keywords are sent to the OCI Generative AI Service
28+
4. Integration with OCI AI Vision and OCI Generative AI Service using OIC:
29+
o Oracle Integration Cloud is used to integrate VBCS app and OCI AI Services.
30+
5. Summarization Process:
31+
o OCI Generative AI Service generates text using the keywords received from OCI Vision service, to create a concise summary of the image.
32+
33+
34+
<img src="./AIVisionAppArch.svg>
35+
</img>
36+
37+
## Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI Service)
38+
In this application,
39+
• The File Picker action in VBCS allows the user to select the image.
40+
• Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service.
41+
• Pass the selected image from VBCS to OCI Vision Service to analyse the image.
42+
• OCI Vision Service analyzes the image and identifies objects within it.
43+
• The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS.
44+
45+
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS)
46+
47+
<img src="./VBCS_Vision.jpg">
48+
</img>
49+
50+
OIC call - Invoke OCI Vision Service
51+
Endpoint - /actions/analyzeImage
52+
53+
<img src="./OIC_VisionService.jpg">
54+
</img>
55+
56+
• User clicks the "Generate" button in the app to initiate the summary generation.
57+
• Configure the OIC integration process to invoke the GenAI service.
58+
• Pass the keywords returned by the OCI Vision Service along with any additional relevant information.
59+
• Generative AI Service processes the received keywords and generates a summary of the image content.
60+
61+
User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS)
62+
63+
<img src="./VBCS_GenerateSummary.jpg">
64+
</img>
65+
66+
OIC call - Invoke OCI Generative AI Service
67+
Endpoint - /20231130/actions/generatText
68+
<img src="./OIC_GenerateSummary.jpg">
69+
</img>
70+
71+
## Code
72+
VBCS app - ImageClassification-1.0.zip
73+
OIC Vision Integration - RESTVISION_01.00.0000.iar
74+
OIC Generate Summary - IMAGEDESCRIPTIONGENERATION_01.00.0000.iar
75+
76+
## Conclusion
77+
78+
In this article, we've covered how to utilise Oracle AI Vision Service features to provide a summary of an image using Geneartive AI service .
79+
Feel free to modify and expand upon this template according to your specific use case and preferences.
80+
81+
82+
# License
83+
84+
Copyright (c) 2024 Oracle and/or its affiliates.
85+
86+
Licensed under the Universal Permissive License (UPL), Version 1.0.
87+
88+
See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
89+

‎ai-and-app-modernisation/ai-services/generative-ai-service/vision-genai/RESTVISION_01.00.0000.iar

21.2 KB
Binary file not shown.

0 commit comments

Comments
 (0)