Merge branch 'main' into jcg-ai-gen-ai-oic-email-analysis

Author: al3xne

cloud-infrastructure/ai-infra-gpu/GPU/vllm-mistral/README.md

@@ -0,0 +1,125 @@
+# Overview
+
+This repository provides a step-by-step tutorial for deploying and using [Mistral 7B Instruct](https://mistral.ai/technology/#models) Large Language Model using the [vLLM](https://github.com/vllm-project/vllm?tab=readme-ov-file) library.
+
+# Requirements
+
+* An OCI tenancy with A10 GPU quota.
+* A [Huggingface](https://huggingface.co/) account with a valid Auth Token.
+
+# Model Deployment
+
+## Mistral models
+
+[Mistral.ai](https://mistral.ai/) is a French AI startup that develop Large Language Models (LLMs). Mistral 7B is the small yet powerful open model that supports English and code. The Mistral 7B Instruct is a chat optimized version of Mistral 7B. Mixtral 8x7B is a 7B sparse Mixture-of-Experts that supports French, Italian, German and Spanish on top of English and code (stronger than Mistral 7B). It uses 12B parameters out of 45B total.
+
+## vLLM Library
+
+vLLM is an alternative model serving solution to NVIDIA Triton. It is easy to use as it comes as a preconfigured container.
+
+## Instance Configuration
+
+In this example a single A10 GPU VM shape, codename VM.GPU.A10.1, is used. The image is the NVIDIA GPU Cloud Machine image from the OCI marketplace. A boot volume of 200 GB is also recommended.
+
+## Image Update
+
+Since the latest NVIDIA GPU Cloud Machine image is almost 1 year old, it is recommended to update NVIDIA drivers and CUDA by running:
+
+```
+sudo apt purge nvidia* libnvidia*
+sudo apt-get install -y cuda-drivers-545
+sudo apt-get install -y nvidia-kernel-open-545
+sudo apt-get install -y cuda-toolkit-12-3
+sudo reboot
+```
+
+## System configuration
+
+Once the NVIDIA packages are updated, it is necessary to reconfigure docker in order to make it GPU aware:
+
+```
+sudo apt-get install -y nvidia-container-toolkit
+sudo nvidia-ctk runtime configure --runtime=docker
+sudo systemctl restart docker
+```
+
+## Container Deployment
+
+To deploy the model, simply run the vLLM container:
+
+```
+docker run --gpus all \
+    -e HF_TOKEN=$HF_TOKEN -p 8000:8000 \
+    ghcr.io/mistralai/mistral-src/vllm:latest \
+    --host 0.0.0.0 \
+    --model mistralai/Mistral-7B-Instruct-v0.2
+```
+where `$HF_TOKEN` is the HuggingFace Auth Token set as an environment variable. Pulling the image for the container may take up to 20 minutes.
+
+Once the deployment is finished, the model is available by default at http://0.0.0.0:8000.
+
+# Model Calling
+
+The Mistral model is available through a OpenAI compatible API. As a prerequisite you must have the curl package installed.
+
+```
+sudo apt-get install curl
+```
+
+Below are 3 examples of curl requests. The `json_pp` utility (JSON Pretty Printer) eases the model output reading by printing the JSON data in a legible, indented format.
+
+* Check the model version available in the container:
+
+```
+curl http://localhost:8000/v1/models | json_pp
+```
+
+* Complete a sentence:
+
+```
+curl http://localhost:8000/v1/completions \
+    -H "Content-Type: application/json" \
+    -d '{
+        "model": "mistralai/Mistral-7B-Instruct-v0.2",
+        "prompt": "A GPU is a",
+        "max_tokens": 128,
+        "temperature": 0.7
+    }' | json_pp
+```
+
+* Chat
+
+```
+curl http://localhost:8000/v1/chat/completions \
+    -H "Content-Type: application/json" \
+    -d '{
+        "model": "mistralai/Mistral-7B-Instruct-v0.2",
+        "messages": [
+            {"role": "user", "content": "Which GPU models are available on Oracle Cloud Infrastructure?"}
+        ]
+    }' | json_pp
+```
+
+# Notes
+
+Mixtral8x7B is much more greedy that Mistral 7B and it will not fit in a single A10 GPU VM, nor a quad A10 GPU BM. Therefore it is necessary to either:
+* Increase the size of the shape to a BM.GPU4.8 (8 x A100 40 GB GPUs).
+* Use a quantized version such as [TheBloke/mixtral-8x7b-v0.1-AWQ](https://huggingface.co/TheBloke/mixtral-8x7b-v0.1-AWQ). However, AWQ quantization on vLLM is not fully optimized yet so speed might be lower than the original model.
+
+```
+docker run --gpus all \
+    -e HF_TOKEN=$HF_TOKEN -p 8000:8000 \
+    vllm/vllm-openai:latest \
+    --host 0.0.0.0 \
+    --port 8000 \
+    --model TheBloke/mixtral-8x7b-v0.1-AWQ \
+    --quantization awq \
+    --tensor-parallel-size 4 \
+    --gpu-memory-utilization 0.95 \
+    --enforce-eager
+```
+
+# Resources
+
+* [vLLM Documentation](https://docs.vllm.ai/en/latest/)
+* [Mistral Documentation](https://docs.mistral.ai/)

cloud-infrastructure/multicloud/README.md

@@ -2,36 +2,49 @@
 
 Multicloud architectures leverage the coordinated use of cloud services from two or more public cloud vendors. Organizations use multicloud environments to distribute computing resources and minimize the risk of downtime and data loss. Organizations may also adopt two or more public cloud providers for their unique capabilities. 
 
+Reviewed: 08.04.2024
 
-## Team Publications
+# Team Publications
+
+## Video Content
 
-- [Learn About Multicloud Architecture Framework](https://docs.oracle.com/en/solutions/learn-about-multicloud-arch-framework/index.html)
 - [Multicloud Is The New Norm - Part I](https://www.youtube.com/watch?v=WzyJiAXldDM)
 - [Multicloud Is The New Norm - Part II](https://www.youtube.com/watch?v=27L_ZeF1o9Q)
 - [Multicloud Is The New Norm - Part III](https://www.youtube.com/watch?v=qesCk_nIvY8) 
-- [Multicloud in the Mainstream - Discovery Report](https://www.oracle.com/uk/cloud/multicloud/industry-mainstream/)
-- [Google Cloud and OCI making the most of multicloud](https://services.google.com/fh/files/misc/google-cloud-oci-guide.pdf)
-- [Use AWS endpoint service to securely connect applications to Oracle Autonomous Database](https://docs.oracle.com/en/solutions/adb-endpoint-in-aws/index.html)
+
+## Blog Posts
+
+- [DNS in multicloud disaster recovery architectures](https://blogs.oracle.com/cloud-infrastructure/post/dns-in-multicloud-disaster-recovery-architectures)
+- [Oracle OCI — encrypted connection to AWS, Azure, GCP](https://aviatrix.com/blog/oracle-oci-encrypted-connection/)
+- [Oracle and Microsoft Simplify the Path to Multicloud Choice](https://blogs.oracle.com/cloud-infrastructure/post/simplify-path-to-multicloud-choice)
 - [ODSA versus the OCI-Azure Interconnect](https://blogs.oracle.com/cloud-infrastructure/post/odsa-versus-oci-azure-interconnect)
 - [Network latency using OCI-Azure Interconnect and best practices](https://blogs.oracle.com/cloud-infrastructure/post/network-latency-oci-azure-best-practices)
 - [Transitive cloud routing in multicloud architectures](https://blogs.oracle.com/cloud-infrastructure/post/transitive-routing-in-multicloud-architectures)
-- [Connect Oracle Data Safe to Oracle databases on multicloud and hybrid cloud environments](https://docs.oracle.com/en/solutions/data-safe-multicloud-ods-hybrid/index.html)
-- [Extend your high availability database architecture to multicloud using OCI GoldenGate replication](https://docs.oracle.com/en/solutions/oci-multicloud-db-replication-goldengate/index.html)
-- [Deploy multicloud Oracle Database Service for Microsoft Azure in a hub and spoke topology](https://docs.oracle.com/en/solutions/odsa-azure-hub-spoke/index.html)
 - [Implementing Oracle Database for Azure with a hub-and-spoke network](https://blogs.oracle.com/cloud-infrastructure/post/implementing-oracledb-azure-hubandspoke-network)
 - [Connecting OCI to GCP with Equinix Network Edge](https://blogs.oracle.com/cloud-infrastructure/connecting-oracle-cloud-infrastructure-to-google-cloud-platform-with-equinix-network-edge-cloud-router)
 - [Connecting OCI to AWS with Megaport](https://blogs.oracle.com/cloud-infrastructure/connecting-oracle-cloud-infrastructure-to-amazon-vpc-with-megaport-cloud-router)
-- [Connecting on prem network to OCI with Colt on demand](https://blogs.oracle.com/cloud-infrastructure/connecting-your-on-premises-network-to-oracle-cloud-with-colt-on-demand)
-- [Deploy a Multicloud split-stack solution across OCI, AWS and GCP](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index)
-- [Best practices for hybrid and Multi Cloud  OCI networking design](https://docs.oracle.com/en/solutions/oci-best-practices-networking/index.html)
-- [Multi cloud patterns to deploy Oracle Applications (EBS, PeopleSoft, JDEdwards) to Azure and OCI](https://learn.microsoft.com/en-us/azure/virtual-machines/workloads/oracle/oracle-oci-applications)
+- [Connecting on-premises network to OCI with Colt on demand](https://blogs.oracle.com/cloud-infrastructure/connecting-your-on-premises-network-to-oracle-cloud-with-colt-on-demand)
+- [Oracle and Microsoft bring Oracle Database@Azure to Europe](https://blogs.oracle.com/cloud-infrastructure/post/oracle-microsoft-databaseazure-europe?source=:so:ch:or:awr::::&SC=:so:ch:or:awr::::&pcode=)
+
+## Reference Architectures
+
+- [Learn About Multicloud Architecture Framework](https://docs.oracle.com/en/solutions/learn-about-multicloud-arch-framework/index.html)
+- [Use AWS endpoint service to securely connect applications to Oracle Autonomous Database](https://docs.oracle.com/en/solutions/adb-endpoint-in-aws/index.html)
+- [Resolve DNS records seamlessly in OCI multicloud architectures](https://docs.oracle.com/en/solutions/resolve-dns-oci/index.html#GUID-84375E55-F207-4A72-84E8-C17CE0CE6BF3)
+- [Connect Oracle Data Safe to Oracle databases on multicloud and hybrid cloud environments](https://docs.oracle.com/en/solutions/data-safe-multicloud-ods-hybrid/index.html)
+- [Extend your high availability database architecture to multicloud using OCI GoldenGate replication](https://docs.oracle.com/en/solutions/oci-multicloud-db-replication-goldengate/index.html)
+- [Deploy multicloud Oracle Database Service for Microsoft Azure in a hub and spoke topology](https://docs.oracle.com/en/solutions/odsa-azure-hub-spoke/index.html)
+- [Deploy a Multicloud split-stack solution across OCI, AWS, and GCP](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index)
+- [Best practices for hybrid and multicloud OCI networking design](https://docs.oracle.com/en/solutions/oci-best-practices-networking/index.html)
+- [Multi cloud patterns to deploy Oracle Applications (EBS, PeopleSoft, JD Edwards) to Azure and OCI](https://learn.microsoft.com/en-us/azure/virtual-machines/workloads/oracle/oracle-oci-applications)
 - [Extend Active Directory integration in Hybrid Cloud](https://docs.oracle.com/en/solutions/integrate-oci-msft-ad/)
-- [Oracle OCI — encrypted connection to AWS, Azure, GCP](https://aviatrix.com/blog/oracle-oci-encrypted-connection/)
-- [DNS in multicloud disaster recovery architectures](https://blogs.oracle.com/cloud-infrastructure/post/dns-in-multicloud-disaster-recovery-architectures)
-- [Oracle and Microsoft Simplify the Path to Multicloud Choice](https://blogs.oracle.com/cloud-infrastructure/post/simplify-path-to-multicloud-choice)
 - [Establish a multi-cloud private network connectivity through Oracle Integration Cloud](https://docs.oracle.com/en/solutions/multi-cloud-with-oic/index.html)
-- [Multicloud split-stack architecture with OCI, GCP and AWS](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index.html)
+- [Multicloud split-stack architecture with OCI, GCP, and AWS](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index.html)
+
+## Certifications
+ 
 - [Become an OCI Multicloud Architect Associate](https://mylearn.oracle.com/ou/learning-path/become-an-oci-multicloud-architect/120606)
+- [Become an Oracle Database@Azure Specialist](https://mylearn.oracle.com/ou/learning-path/become-an-oracle-databaseazure-specialist/135857)
 
 # License
 

cloud-infrastructure/multicloud/azure-interconnect/README.md

@@ -2,12 +2,14 @@
 
 Oracle Interconnect for Microsoft Azure provides organizations with a simple migration path to a multicloud environment that includes Oracle Database capabilities such as Oracle Exadata Database Service, Autonomous Database, and MySQL HeatWave. Customers can innovate using the best of Oracle Cloud Infrastructure (OCI) and Microsoft Azure with seamless interoperability.
 
+Reviewed: 08.04.2024
+
 # Table of Contents
 
 - [Team Publications](#team-publications)
 - [Useful Links](#useful-links)
 
-## Team Publications
+# Team Publications
 
 - [Simplify OCI and Azure Interconnect encryption and observation for multicloud using Aviatrix](https://blogs.oracle.com/cloud-infrastructure/post/simplify-ociazure-interconnect-observation-using-aviatrix)
 - [Enabling redundancy between 2 Azure interconnect connections](https://www.ateam-oracle.com/post/oci-azure-interconnect-advanced-scenarios---part2)
@@ -25,7 +27,7 @@ Oracle Interconnect for Microsoft Azure provides organizations with a simple mig
 - [Deploy the Oracle Cloud and Microsoft Azure Interconnect Using Hub-and-Spoke Topology](https://docs.oracle.com/en-us/iaas/Content/Resources/Assets/whitepapers/deploy_oracle_cloud_and_microsoft_azure_interconnect_using_hub_spoke_topology.pdf)
 
 
-## Useful Links
+# Useful Links
 
 - [Original Service Press release](https://www.oracle.com/corporate/pressrelease/microsoft-and-oracle-to-interconnect-microsoft-azure-and-oracle-cloud-060519.html)
 - [Service Landing Page](https://www.oracle.com/cloud/azure/interconnect/)

cloud-infrastructure/multicloud/connectivity-partners/README.md

@@ -2,12 +2,9 @@
 
 Oracle has integrated the FastConnect service with a geographically diverse set of IP, VPN, and Ethernet network providers and cloud exchanges to make it easy for you to establish a connection to Oracle Cloud services. You can establish a FastConnect connection from your on-premise or other cloud service providers to the data center where your Oracle Cloud resources are provisioned by requesting cloud connectivity services from any of Oracle's FastConnect partners.
 
-# Table of Contents
- 
-1. [Useful Links](#useful-uinks)
- 
- 
-## Useful Links
+Reviewed: 08.04.2024
+
+# Useful Links
 
 - [FastConnect Connectivity Partners ](https://www.oracle.com/uk/cloud/networking/fastconnect/connectivity-partners/)
 - [FastConnect Partners by Region](https://www.oracle.com/uk/cloud/networking/fastconnect/providers/#emea)

cloud-infrastructure/multicloud/federation-azure/README.md

@@ -1,15 +1,16 @@
 # OCI Implementation Series: Multicloud Federation Setup (Azure) and Solution Efficiency with JIT
-  
-# Table of Contents
 
-1. [Team Publications](#team-publications)
+Multicloud is a cloud computing strategy that incorporates the best services from more than one public cloud provider to deploy a solution. This enables customers to meet diverse business requirements and ensure they are choosing the best cloud provider for each workload, based on capabilities, requirements, and performance.
+
+With Oracle Cloud Infrastructure (OCI) being one of the leading cloud platforms, organizations often find themselves in the position of utilizing OCI services along with at least one other cloud provider to meet their business requirements.
+
+Multicloud IAM solution simplifies administration and plays a vital role in ensuring secure access to resources, controlling permissions, and maintaining compliance. Oracle Cloud Lift Services has implemented solutions that address these challenges for various enterprise customers in multicloud environment setup. 
+
+Reviewed: 08.04.2024
 
 # Team Publications
 
 - [OCI Implementation Series: Multicloud Federation Setup (Azure) and Solution Efficiency with JIT](https://blogs.oracle.com/futurestate/post/oci-implementation-series-multicloud-federation-setup-azure-solution-efficiency-with-jit). <!-- LIFT -->
-- Multicloud is a cloud computing strategy that incorporates the best services from more than one public cloud provider to deploy a solution. This enables customers to meet diverse business requirements and ensure they are choosing the best cloud provider for each workload, based on capabilities, requirements, and performance.
-- With Oracle Cloud Infrastructure (OCI) being one of the leading cloud platforms, organizations often find themselves in the position of utilizing OCI services along with at least one other cloud provider to meet their business requirements.
-- Multicloud IAM solution simplifies administration and plays a vital role in ensuring secure access to resources, controlling permissions, and maintaining compliance. Oracle Cloud Lift Services has implemented solutions that address these challenges for various enterprise customers in multicloud environment setup. 
 
 # License
 

cloud-infrastructure/multicloud/integrate-okta-iam/README.md

@@ -1,15 +1,14 @@
 # OCI Implementation Series: Integrate Okta IAM with OCI Identity Domain in Hybrid Cloud Environment Setup
 
-# Table of Contents
+As organizations increasingly adopt multi-cloud and hybrid cloud infrastructures, managing identity and access across multiple environments can become a complex and challenging task. Traditional Identity and Access Management (IAM) solutions often struggle to keep up with the evolving cloud landscape, leaving organizations vulnerable to security breaches and compliance issues.
 
-1. [Team Publications](#team-publications)
+A multi-cloud/hybrid cloud IAM solution offers a comprehensive approach to managing identities, access, and security across multiple environments. By providing a centralized platform that can manage access to multiple cloud services and applications, a multi-cloud/hybrid cloud IAM solution simplifies IAM administration and strengthens security. Oracle Cloud Lift Services has implemented solutions that address these challenges. 
+
+Reviewed: 08.04.2024
 
 # Team Publications
 
 - [OCI Implementation Series: Integrate Okta IAM with OCI Identity Domain in Hybrid Cloud Environment Setup](https://blogs.oracle.com/futurestate/post/oci-implementation-series-integrate-okta-iam-with-oci-identity-domain-in-hybrid-cloud-environment-setup). <!-- LIFT -->
-- As organizations increasingly adopt multi-cloud and hybrid cloud infrastructures, managing identity and access across multiple environments can become a complex and challenging task. Traditional Identity and Access Management (IAM) solutions often struggle to keep up with the evolving cloud landscape, leaving organizations vulnerable to security breaches and compliance issues.
-- A multi-cloud/hybrid cloud IAM solution offers a comprehensive approach to managing identities, access, and security across multiple environments. By providing a centralized platform that can manage access to multiple cloud services and applications, a multi-cloud/hybrid cloud IAM solution simplifies IAM administration and strengthens security. Oracle Cloud Lift Services has implemented solutions that address these challenges. 
- 
 
 # License