|
1 | | -# Summarize Image using OCI AI Vision Service and OCI Generative AI Service |
2 | | - |
3 | | -## Introduction |
4 | | -In this article, we'll explore how to describe an image using OCI AI Vision Service and OCI Generative AI Service. |
5 | | -The application is developed using Oracle VBCS, OIC , OCI AI Vision service and OCI Generative AI Service. |
6 | | -This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for an efficient and insightful summarization of image content. |
7 | | - |
8 | | -<img src="./AIVisionApp.jpg> |
9 | | -</img> |
10 | | - |
11 | | -## Prerequisites |
12 | | - |
13 | | -Before getting started, make sure you have the access to these services: |
14 | | - |
15 | | -- Oracle Generative AI Service |
16 | | -- Oracle Vision Service |
17 | | -- Oracle Visual Builder Cloud Service |
18 | | -- Oracle Integration Cloud |
19 | | - |
20 | | -## AI Vision and OCI Generative AI Service Integration Architecture |
21 | | -1. AI Vision App using VBCS |
22 | | - o Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS. |
23 | | -2. Image Analysis with OCI AI Vision Service: |
24 | | - o The AI Vision service is employed to analyse images. |
25 | | - o It identifies objects within the image by using advanced computer vision algorithms. |
26 | | -3. Integration with OCI Generative AI Service: |
27 | | - o The extracted object keywords are sent to the OCI Generative AI Service |
28 | | -4. Integration with OCI AI Vision and OCI Generative AI Service using OIC: |
29 | | - o Oracle Integration Cloud is used to integrate VBCS app and OCI AI Services. |
30 | | -5. Summarization Process: |
31 | | - o OCI Generative AI Service generates text using the keywords received from OCI Vision service, to create a concise summary of the image. |
32 | | - |
33 | | - |
34 | | -<img src="./AIVisionAppArch.svg> |
35 | | -</img> |
36 | | - |
37 | | -## Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI Service) |
38 | | - In this application, |
39 | | - • The File Picker action in VBCS allows the user to select the image. |
40 | | - • Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service. |
41 | | - • Pass the selected image from VBCS to OCI Vision Service to analyse the image. |
42 | | - • OCI Vision Service analyzes the image and identifies objects within it. |
43 | | - • The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS. |
44 | | - |
45 | | - User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS) |
46 | | - |
47 | | - <img src="./VBCS_Vision.jpg"> |
48 | | - </img> |
49 | | - |
50 | | - OIC call - Invoke OCI Vision Service |
51 | | - Endpoint - /actions/analyzeImage |
52 | | - |
53 | | - <img src="./OIC_VisionService.jpg"> |
54 | | - </img> |
55 | | - |
56 | | - • User clicks the "Generate" button in the app to initiate the summary generation. |
57 | | - • Configure the OIC integration process to invoke the GenAI service. |
58 | | - • Pass the keywords returned by the OCI Vision Service along with any additional relevant information. |
59 | | - • Generative AI Service processes the received keywords and generates a summary of the image content. |
60 | | - |
61 | | - User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS) |
62 | | - |
63 | | - <img src="./VBCS_GenerateSummary.jpg"> |
64 | | - </img> |
65 | | - |
66 | | - OIC call - Invoke OCI Generative AI Service |
67 | | - Endpoint - /20231130/actions/generatText |
68 | | - <img src="./OIC_GenerateSummary.jpg"> |
69 | | - </img> |
70 | | - |
71 | | -## Conclusion |
72 | | - |
73 | | -In this article, we've covered how to utilise Oracle AI Vision Service features to provide a summary of an image using Geneartive AI service . |
74 | | -Feel free to modify and expand upon this template according to your specific use case and preferences. |
75 | | - |
76 | | - |
77 | | -# License |
78 | | - |
79 | | -Copyright (c) 2024 Oracle and/or its affiliates. |
80 | | - |
81 | | -Licensed under the Universal Permissive License (UPL), Version 1.0. |
82 | | - |
83 | | -See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details. |
| 1 | +# Summarize Image using OCI AI Vision Service and OCI Generative AI Service |
| 2 | + |
| 3 | +## Introduction |
| 4 | +In this article, we'll explore how to describe an image using OCI AI Vision Service and OCI Generative AI Service. |
| 5 | +The application is developed using Oracle VBCS, OIC , OCI AI Vision service and OCI Generative AI Service. |
| 6 | +This integrated approach combines the strength of OCI AI Vision and OCI Generative AI Service, allowing for an efficient and insightful summarization of image content. |
| 7 | + |
| 8 | +<img src="./AIVisionApp.jpg> |
| 9 | +</img> |
| 10 | + |
| 11 | +## Prerequisites |
| 12 | + |
| 13 | +Before getting started, make sure you have the access to these services: |
| 14 | + |
| 15 | +- Oracle Generative AI Service |
| 16 | +- Oracle Vision Service |
| 17 | +- Oracle Visual Builder Cloud Service |
| 18 | +- Oracle Integration Cloud |
| 19 | + |
| 20 | +## AI Vision and OCI Generative AI Service Integration Architecture |
| 21 | +1. AI Vision App using VBCS |
| 22 | + o Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based development service to create, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS. |
| 23 | +2. Image Analysis with OCI AI Vision Service: |
| 24 | + o The AI Vision service is employed to analyse images. |
| 25 | + o It identifies objects within the image by using advanced computer vision algorithms. |
| 26 | +3. Integration with OCI Generative AI Service: |
| 27 | + o The extracted object keywords are sent to the OCI Generative AI Service |
| 28 | +4. Integration with OCI AI Vision and OCI Generative AI Service using OIC: |
| 29 | + o Oracle Integration Cloud is used to integrate VBCS app and OCI AI Services. |
| 30 | +5. Summarization Process: |
| 31 | + o OCI Generative AI Service generates text using the keywords received from OCI Vision service, to create a concise summary of the image. |
| 32 | + |
| 33 | + |
| 34 | +<img src="./AIVisionAppArch.svg> |
| 35 | +</img> |
| 36 | + |
| 37 | +## Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI Service) |
| 38 | + In this application, |
| 39 | + • The File Picker action in VBCS allows the user to select the image. |
| 40 | + • Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service. |
| 41 | + • Pass the selected image from VBCS to OCI Vision Service to analyse the image. |
| 42 | + • OCI Vision Service analyzes the image and identifies objects within it. |
| 43 | + • The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS. |
| 44 | + |
| 45 | + User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS) |
| 46 | + |
| 47 | + <img src="./VBCS_Vision.jpg"> |
| 48 | + </img> |
| 49 | + |
| 50 | + OIC call - Invoke OCI Vision Service |
| 51 | + Endpoint - /actions/analyzeImage |
| 52 | + |
| 53 | + <img src="./OIC_VisionService.jpg"> |
| 54 | + </img> |
| 55 | + |
| 56 | + • User clicks the "Generate" button in the app to initiate the summary generation. |
| 57 | + • Configure the OIC integration process to invoke the GenAI service. |
| 58 | + • Pass the keywords returned by the OCI Vision Service along with any additional relevant information. |
| 59 | + • Generative AI Service processes the received keywords and generates a summary of the image content. |
| 60 | + |
| 61 | + User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS) |
| 62 | + |
| 63 | + <img src="./VBCS_GenerateSummary.jpg"> |
| 64 | + </img> |
| 65 | + |
| 66 | + OIC call - Invoke OCI Generative AI Service |
| 67 | + Endpoint - /20231130/actions/generatText |
| 68 | + <img src="./OIC_GenerateSummary.jpg"> |
| 69 | + </img> |
| 70 | + |
| 71 | +## Code |
| 72 | + VBCS app - ImageClassification-1.0.zip |
| 73 | + OIC Vision Integration - RESTVISION_01.00.0000.iar |
| 74 | + OIC Generate Summary - IMAGEDESCRIPTIONGENERATION_01.00.0000.iar |
| 75 | + |
| 76 | +## Conclusion |
| 77 | + |
| 78 | +In this article, we've covered how to utilise Oracle AI Vision Service features to provide a summary of an image using Geneartive AI service . |
| 79 | +Feel free to modify and expand upon this template according to your specific use case and preferences. |
| 80 | + |
| 81 | + |
| 82 | +# License |
| 83 | + |
| 84 | +Copyright (c) 2024 Oracle and/or its affiliates. |
| 85 | + |
| 86 | +Licensed under the Universal Permissive License (UPL), Version 1.0. |
| 87 | + |
| 88 | +See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details. |
| 89 | + |
0 commit comments