|
| 1 | +# Summarize Image using OCI AI Vision Service and OCI Generative AI Service |
| 2 | + |
| 3 | +## Introduction |
| 4 | +In this article, we'll explore how to summarize an image using OCI AI Vision Service and OCI Generative AI Service. |
| 5 | +The application is developed using Oracle VBCS, OIC , OCI AI Vision service and OCI Generative AI Service. |
| 6 | +This integrated approach combines the strengths of OCI AI Vision and OCI Generative AI Service, allowing for efficient and insightful summarization of image content. |
| 7 | + |
| 8 | +<img src="./AIVisionApp.jpg> |
| 9 | +</img> |
| 10 | + |
| 11 | +## Prerequisites |
| 12 | + |
| 13 | +Before getting started, make sure you have the access to following services: |
| 14 | + |
| 15 | +- Oracle Generative AI Service |
| 16 | +- Oracle Vision Service |
| 17 | +- Oracle Visual Builder Cloud Service |
| 18 | +- Oracle Integration Cloud |
| 19 | + |
| 20 | +## AI Vision and OCI Generative AI Service Integration Architecture |
| 21 | +1. AI Vision App using VBCS |
| 22 | + o Oracle Visual Builder Cloud Service (VBCS) is a hosted environment for your application development infrastructure. It provides an open-source standards-based integration to develop, collaborate on, and deploy applications within Oracle Cloud. This application is developed in VBCS. |
| 23 | +2. Image Analysis with OCI AI Vision Service: |
| 24 | + o The AI Vision service is employed to analyse images. |
| 25 | + o It identifies objects within the image using advanced computer vision algorithms. |
| 26 | +3. Integration with OCI Generative AI Service: |
| 27 | + o The extracted object keywords are sent to the OCI Generative AI Service |
| 28 | +4. Integration with OCI AI Vision and OCI Generative AI Service using OIC: |
| 29 | + o Oracle Integration Cloud is used to integrate VBCS app and OCI AI Services. |
| 30 | +5. Summarization Process: |
| 31 | + o OCI Generative AI Service generate text utilizes the received keywords from OCI Vision service to generate a concise summary of the image. |
| 32 | + |
| 33 | + |
| 34 | +<img src="./AIVisionAppArch.svg> |
| 35 | +</img> |
| 36 | + |
| 37 | +## Application Flow in Detail (VBCS, OIC, OCI Vision, OCI Generative AI) |
| 38 | + In this app, |
| 39 | + • The File Picker action in VBCS allow the user to select the image. |
| 40 | + • Create an integration process in Oracle Integration Cloud (OIC) to handle the communication between VBCS and OCI Vision Service. |
| 41 | + • Pass the selected image from VBCS to OCI Vision Service to analyse the image. |
| 42 | + • OCI Vision Service analyzes the image and identifies objects within it. |
| 43 | + • The OCI Vision Service returns the detected objects (keywords) to the OIC integration process and returns the results to VBCS. |
| 44 | + |
| 45 | + User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Objects| --> (OIC) --> |Result| --> (VBCS) |
| 46 | + |
| 47 | + <img src="./VBCS_Vision.jpg"> |
| 48 | + </img> |
| 49 | + |
| 50 | + OIC call - Invoke OCI Vision Service |
| 51 | + Endpoint - /actions/analyzeImage |
| 52 | + |
| 53 | + <img src="./OIC_VisionService.jpg"> |
| 54 | + </img> |
| 55 | + |
| 56 | + • User clicks the "Generate" button in the app to initiate the summary generation. |
| 57 | + • Configure the OIC integration process to invoke the GenAI service. |
| 58 | + • Pass the keywords returned by the OCI Vision Service along with any additional relevant information. |
| 59 | + • GenAI service processes the received keywords and generates a summary of the image content. |
| 60 | + |
| 61 | + User (VBCS) --> (File Picker) --> |Image| --> (OIC) --> |OCI Vision Service| --> |Detected Keywords| --> (OIC) --> | OCI Generative AI Service --> |Summary| --> (OIC) --> |Result| --> (VBCS) |
| 62 | + |
| 63 | + <img src="./VBCS_GenerateSummary.jpg"> |
| 64 | + </img> |
| 65 | + |
| 66 | + OIC call - Invoke OCI Generative AI Service |
| 67 | + Endpoint - /20231130/actions/generatText |
| 68 | + <img src="./OIC_GenerateSummary.jpg"> |
| 69 | + </img> |
| 70 | + |
| 71 | +## Conclusion |
| 72 | + |
| 73 | +In this article, we've covered how to utilise Oracle AI Vision Service features to provide summary of an image using Geneartive AI service . |
| 74 | + |
| 75 | +Feel free to modify and expand upon this template according to your specific use case and preferences. Good luck with your article! |
| 76 | + |
| 77 | + |
| 78 | +# License |
| 79 | + |
| 80 | +Copyright (c) 2024 Oracle and/or its affiliates. |
| 81 | + |
| 82 | +Licensed under the Universal Permissive License (UPL), Version 1.0. |
| 83 | + |
| 84 | +See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details. |
0 commit comments