Merge branch 'ejaz-updates' of github.com:oracle-devrel/technology-engineering into ejaz-updates

Ej4z4K · Ej4z4K · commit c1a52fce1141 · 2024-04-12T14:43:55.000+01:00
diff --git a/cloud-infrastructure/ai-infra-gpu/GPU/README.md b/cloud-infrastructure/ai-infra-gpu/GPU/README.md
@@ -1,4 +1,4 @@
-# GPU compute instances
+# GPU Compute Instances
  
 This repository contains detailed information related to Oracle Cloud Infrastructure GPU compute instances.
  
@@ -23,6 +23,8 @@ Reviewed: 26.02.20224
     - Powering protein large language models in antibody discovery on OCI
  - [Customer sentiment analysis using VM.GPU.A10](https://blogs.oracle.com/cloud-infrastructure/post/oci-ai-language-nonenglish-language-use-case)
     - This experiment involved deploying a VM.GPU.A10 instance to run Python code, translating approximately 1,100 hotel reviews from Hebrew to English using AlephBERT and Google Translate
+ - [Pioneering de novo antibody design with OCI, supporting Silica Corpora’s AI mission for unmatched precision and efficacy](https://blogs.oracle.com/cloud-infrastructure/post/de-novo-antibody-design-oci-silica-corpora)
+    - About the collaboration between Silica Corpora and Oracle Cloud Infrastructure in leveraging generative AI and robust cloud capabilities to revolutionize de novo antibody design for enhanced precision and efficacy in drug development
 
 
 ## LiveLabs
@@ -45,7 +47,7 @@ Reviewed: 26.02.20224
  ## Re-useable Assets
 
 - [Navigating the AI Revolution: Opportunities and Challenges - German - efcom Symposium 2023](https://www.youtube.com/watch?v=r_ZG2sUzhqo)
-    - For all German speakers interested in hearing high-level about the foundations of GPU, what AI is (and how it is connected to Machine Learning, Data Science, LLM, GenAI) and how Oracle is approaching it.
+    - For all German speakers interested in hearing high-level about the foundations of GPU, what AI is (and how it is connected to Machine Learning, Data Science, LLM, GenAI), and how Oracle is approaching it.
 
 # Useful Links
  
diff --git a/cloud-infrastructure/ai-infra-gpu/GPU/vllm-mistral/README.md b/cloud-infrastructure/ai-infra-gpu/GPU/vllm-mistral/README.md
@@ -0,0 +1,125 @@
+# Overview
+
+This repository provides a step-by-step tutorial for deploying and using [Mistral 7B Instruct](https://mistral.ai/technology/#models) Large Language Model using the [vLLM](https://github.com/vllm-project/vllm?tab=readme-ov-file) library.
+
+# Requirements
+
+* An OCI tenancy with A10 GPU quota.
+* A [Huggingface](https://huggingface.co/) account with a valid Auth Token.
+
+# Model Deployment
+
+## Mistral models
+
+[Mistral.ai](https://mistral.ai/) is a French AI startup that develop Large Language Models (LLMs). Mistral 7B is the small yet powerful open model that supports English and code. The Mistral 7B Instruct is a chat optimized version of Mistral 7B. Mixtral 8x7B is a 7B sparse Mixture-of-Experts that supports French, Italian, German and Spanish on top of English and code (stronger than Mistral 7B). It uses 12B parameters out of 45B total.
+
+## vLLM Library
+
+vLLM is an alternative model serving solution to NVIDIA Triton. It is easy to use as it comes as a preconfigured container.
+
+## Instance Configuration
+
+In this example a single A10 GPU VM shape, codename VM.GPU.A10.1, is used. The image is the NVIDIA GPU Cloud Machine image from the OCI marketplace. A boot volume of 200 GB is also recommended.
+
+## Image Update
+
+Since the latest NVIDIA GPU Cloud Machine image is almost 1 year old, it is recommended to update NVIDIA drivers and CUDA by running:
+
+```
+sudo apt purge nvidia* libnvidia*
+sudo apt-get install -y cuda-drivers-545
+sudo apt-get install -y nvidia-kernel-open-545
+sudo apt-get install -y cuda-toolkit-12-3
+sudo reboot
+```
+
+## System configuration
+
+Once the NVIDIA packages are updated, it is necessary to reconfigure docker in order to make it GPU aware:
+
+```
+sudo apt-get install -y nvidia-container-toolkit
+sudo nvidia-ctk runtime configure --runtime=docker
+sudo systemctl restart docker
+```
+
+## Container Deployment
+
+To deploy the model, simply run the vLLM container:
+
+```
+docker run --gpus all \
+    -e HF_TOKEN=$HF_TOKEN -p 8000:8000 \
+    ghcr.io/mistralai/mistral-src/vllm:latest \
+    --host 0.0.0.0 \
+    --model mistralai/Mistral-7B-Instruct-v0.2
+```
+where `$HF_TOKEN` is the HuggingFace Auth Token set as an environment variable. Pulling the image for the container may take up to 20 minutes.
+
+Once the deployment is finished, the model is available by default at http://0.0.0.0:8000.
+
+# Model Calling
+
+The Mistral model is available through a OpenAI compatible API. As a prerequisite you must have the curl package installed.
+
+```
+sudo apt-get install curl
+```
+
+Below are 3 examples of curl requests. The `json_pp` utility (JSON Pretty Printer) eases the model output reading by printing the JSON data in a legible, indented format.
+
+* Check the model version available in the container:
+
+```
+curl http://localhost:8000/v1/models | json_pp
+```
+
+* Complete a sentence:
+
+```
+curl http://localhost:8000/v1/completions \
+    -H "Content-Type: application/json" \
+    -d '{
+        "model": "mistralai/Mistral-7B-Instruct-v0.2",
+        "prompt": "A GPU is a",
+        "max_tokens": 128,
+        "temperature": 0.7
+    }' | json_pp
+```
+
+* Chat
+
+```
+curl http://localhost:8000/v1/chat/completions \
+    -H "Content-Type: application/json" \
+    -d '{
+        "model": "mistralai/Mistral-7B-Instruct-v0.2",
+        "messages": [
+            {"role": "user", "content": "Which GPU models are available on Oracle Cloud Infrastructure?"}
+        ]
+    }' | json_pp
+```
+
+# Notes
+
+Mixtral8x7B is much more greedy that Mistral 7B and it will not fit in a single A10 GPU VM, nor a quad A10 GPU BM. Therefore it is necessary to either:
+* Increase the size of the shape to a BM.GPU4.8 (8 x A100 40 GB GPUs).
+* Use a quantized version such as [TheBloke/mixtral-8x7b-v0.1-AWQ](https://huggingface.co/TheBloke/mixtral-8x7b-v0.1-AWQ). However, AWQ quantization on vLLM is not fully optimized yet so speed might be lower than the original model.
+
+```
+docker run --gpus all \
+    -e HF_TOKEN=$HF_TOKEN -p 8000:8000 \
+    vllm/vllm-openai:latest \
+    --host 0.0.0.0 \
+    --port 8000 \
+    --model TheBloke/mixtral-8x7b-v0.1-AWQ \
+    --quantization awq \
+    --tensor-parallel-size 4 \
+    --gpu-memory-utilization 0.95 \
+    --enforce-eager
+```
+
+# Resources
+
+* [vLLM Documentation](https://docs.vllm.ai/en/latest/)
+* [Mistral Documentation](https://docs.mistral.ai/)
diff --git a/cloud-infrastructure/multicloud/README.md b/cloud-infrastructure/multicloud/README.md
@@ -23,7 +23,7 @@ Reviewed: 08.04.2024
 - [Implementing Oracle Database for Azure with a hub-and-spoke network](https://blogs.oracle.com/cloud-infrastructure/post/implementing-oracledb-azure-hubandspoke-network)
 - [Connecting OCI to GCP with Equinix Network Edge](https://blogs.oracle.com/cloud-infrastructure/connecting-oracle-cloud-infrastructure-to-google-cloud-platform-with-equinix-network-edge-cloud-router)
 - [Connecting OCI to AWS with Megaport](https://blogs.oracle.com/cloud-infrastructure/connecting-oracle-cloud-infrastructure-to-amazon-vpc-with-megaport-cloud-router)
-- [Connecting on prem network to OCI with Colt on demand](https://blogs.oracle.com/cloud-infrastructure/connecting-your-on-premises-network-to-oracle-cloud-with-colt-on-demand)
+- [Connecting on-premises network to OCI with Colt on demand](https://blogs.oracle.com/cloud-infrastructure/connecting-your-on-premises-network-to-oracle-cloud-with-colt-on-demand)
 - [Oracle and Microsoft bring Oracle Database@Azure to Europe](https://blogs.oracle.com/cloud-infrastructure/post/oracle-microsoft-databaseazure-europe?source=:so:ch:or:awr::::&SC=:so:ch:or:awr::::&pcode=)
 
 ## Reference Architectures
@@ -34,14 +34,14 @@ Reviewed: 08.04.2024
 - [Connect Oracle Data Safe to Oracle databases on multicloud and hybrid cloud environments](https://docs.oracle.com/en/solutions/data-safe-multicloud-ods-hybrid/index.html)
 - [Extend your high availability database architecture to multicloud using OCI GoldenGate replication](https://docs.oracle.com/en/solutions/oci-multicloud-db-replication-goldengate/index.html)
 - [Deploy multicloud Oracle Database Service for Microsoft Azure in a hub and spoke topology](https://docs.oracle.com/en/solutions/odsa-azure-hub-spoke/index.html)
-- [Deploy a Multicloud split-stack solution across OCI, AWS and GCP](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index)
-- [Best practices for hybrid and Multi Cloud  OCI networking design](https://docs.oracle.com/en/solutions/oci-best-practices-networking/index.html)
+- [Deploy a Multicloud split-stack solution across OCI, AWS, and GCP](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index)
+- [Best practices for hybrid and multicloud OCI networking design](https://docs.oracle.com/en/solutions/oci-best-practices-networking/index.html)
 - [Multi cloud patterns to deploy Oracle Applications (EBS, PeopleSoft, JD Edwards) to Azure and OCI](https://learn.microsoft.com/en-us/azure/virtual-machines/workloads/oracle/oracle-oci-applications)
 - [Extend Active Directory integration in Hybrid Cloud](https://docs.oracle.com/en/solutions/integrate-oci-msft-ad/)
 - [Establish a multi-cloud private network connectivity through Oracle Integration Cloud](https://docs.oracle.com/en/solutions/multi-cloud-with-oic/index.html)
-- [Multicloud split-stack architecture with OCI, GCP and AWS](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index.html)
+- [Multicloud split-stack architecture with OCI, GCP, and AWS](https://docs.oracle.com/en/solutions/oci-aws-gcp-multicloud/index.html)
 
-## Certificatons
+## Certifications
  
 - [Become an OCI Multicloud Architect Associate](https://mylearn.oracle.com/ou/learning-path/become-an-oci-multicloud-architect/120606)
 - [Become an Oracle Database@Azure Specialist](https://mylearn.oracle.com/ou/learning-path/become-an-oracle-databaseazure-specialist/135857)
diff --git a/data-platform/core-converged-db/mongodb-api/README.md b/data-platform/core-converged-db/mongodb-api/README.md
@@ -1,11 +1,43 @@
 # MongoDB API
 
-Reviewed: 02.04.2024
+Oracle Database API for MongoDB (short MongoDB API) lets applications interact with collections of JSON documents in Oracle Database using MongoDB commands. MongoDB developers can continue to use their usual tools and drivers to perform collection operations. Migrations from MongoDB workloads to Oracle have become easy since no or only minor application changes are required except for the connection string. A major advantage is that JSON Collections can be used with SQL and thus the functionality of the whole Oracle platform is available. 
+
+Oracle Database API for MongoDB is provided as part of Oracle Autonomous Database Serverless. You can enable it there using the Oracle Cloud Infrastructure Console. If you have Oracle REST Data Services (ORDS) release 22.3 or later installed, you can use the MongoDB API with any Oracle database, release 21c or later, as well as with any Oracle Autonomous Database, release 19c (serverless, dedicated, and cloud@customer).
+
+Reviewed: 10.04.2024
+
+# Useful Links
+
+## Documentation
+
+- [Oracle Database API for MongoDB](https://docs.oracle.com/en/database/oracle/mongodb-api/mgapi/overview-oracle-database-api-mongodb.html)
+- [Using Oracle Autonomous Database Serverless](https://docs.oracle.com/en/cloud/paas/autonomous-database/serverless/adbsb/mongo-using-oracle-database-api-mongodb.html#GUID-49018B09-9712-44DC-A950-B8129E7DA0D2)
+- [Oracle Database API for MongoDB (paper)](https://docs.oracle.com/en/database/oracle/mongodb-api/mgapi/oracle-database-api-mongodb.pdf)
+
+## Blogs
+
+- [Use JSON Relational Duality with Oracle Database API for Mongo DB](https://blogs.oracle.com/datawarehousing/post/use-json-relational-duality-with-oracle-database-api-for-mongo-db)
+- [Installing Database API for MongoDB for any Oracle Database](https://blogs.oracle.com/database/post/installing-database-api-for-mongodb-for-any-oracle-database)
+- [Oracle Database API for MongoDB - Best Practices](https://blogs.oracle.com/datawarehousing/post/oracle-database-api-for-mongodb-best-practices)
+
+## LiveLabs Workshops
+
+- [Use the Oracle Database API for MongoDB](https://apexapps.oracle.com/pls/apex/f?p=133:180:113545160863506::::wid:3152)
+
+## Video
+
+- [Get Started with the New Oracle Database API for MongoDB](https://www.youtube.com/watch?v=CdvjHGtaqeU)
+- [Store and analyze JSON data using the Oracle API for MongoDB and SQL/JSON I Oracle Database World](https://www.youtube.com/watch?v=EVDn4b6u628)
+
+# Team Publications
+
+- [JSON, SODA, REST, and Oracle Database API for MongoDB](https://blogs.oracle.com/coretec/post/json-soda-rest-and-oracle-database-api-for-mongodb)
+- [Oracle Database 23c Development Edition on Docker](https://blogs.oracle.com/coretec/post/oracle-database-23c-development-edition-on-docker#img)
 
 # License
 
 Copyright (c) 2024 Oracle and/or its affiliates.
 
 Licensed under the Universal Permissive License (UPL), Version 1.0.
 
-See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
+See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
diff --git a/data-platform/core-converged-db/oracle-text/README.md b/data-platform/core-converged-db/oracle-text/README.md
@@ -4,7 +4,7 @@ Oracle Text is a full-text search that is fully integrated into the Oracle Datab
 
 Oracle Text can perform linguistic analysis on documents, mining capabilities, classification, clustering, etc.
 
-Review Date: 03.06.2024
+Reviewed Date: 10.04.2024
 
 # Useful Links
 
@@ -38,6 +38,7 @@ Review Date: 03.06.2024
 
 - [New full-text search in 23c: Ubiquitous Database Search](https://blogs.oracle.com/coretec/post/ubiquitous-database-search-in-23c)
 - [Easy Database Search with APEX in 23c](https://blogs.oracle.com/coretec/post/easy-database-search-with-apex-in-23c)
+- [Text Index with Automatic Maintenance](https://blogs.oracle.com/coretec/post/text-index-with-automatic-maintenance)
 
 # License
 
diff --git a/data-platform/data-development/sql-tools/SQL-Do It Yourself/README.md b/data-platform/data-development/sql-tools/SQL-Do It Yourself/README.md
@@ -1,14 +1,106 @@
 # SQL - Do It yourself 
+**Welcome to the "SQL - Do it Yourself" section, dedicated to empowering you with comprehensive resources and tips to master Oracle SQL tools and techniques. Whether you're a beginner or an experienced SQL user, this section aims to enhance your SQL proficiency and productivity.**
+
 This section covers Public Oracle SQL Tools: Use of SQL in extensive way: from SQL Developer to sqlplus and SQLcl.
 Providing links to public useful documentation about SQL use and tips. SQL Tips on Fortnight basis and and articles/blogs written by Oracle SQL and Database Advocates and Product Managers and SQL examples are shown here.
 A SQL Clue Card is also provided.
 
 # Table of Contents
 
-TBD
+1. [Public Oracle SQL Tools](#public-oracle-sql-tools)
+
+    1.1. [SQL Tips](#sql-tips)
+
+    1.2. [Articles/Blogs](#articlesblogs)
+
+    1.3. [SQL Examples](#sql-examples)
+
+    1.4. [SQL Clue Card](#sql-clue-card)
+
+2. [SQLcl](#sqlcl)
+
+    2.1. [Features of SQLcl](#features-of-sqlcl)
+    
+    2.2. [Resources](#resources)
+
+    2.3. [Getting Started](#getting-started)
+    
+
+## 1. Public Oracle SQL Tools
+
+Explore a variety of Oracle SQL tools to streamline your database management tasks:
+
+- **SQL Developer**: Oracle SQL Developer provides a powerful integrated development environment (IDE) for Oracle Database. Discover its features and functionalities to optimize your SQL workflow.
+  - [Official Documentation](https://docs.oracle.com/cd/E12151_01/index.htm)
+  - [Getting Started Guide](https://docs.oracle.com/cd/E25259_01/appdev.31/e24285/toc.htm)
+  - [Video Tutorials](link)
+
+- **sqlplus**: Master the command-line interface for Oracle Database with sqlplus. Learn essential commands and best practices for efficient SQL execution.
+  - [Official Documentation](link)
+  - [Command Reference](link)
+  - [Tips and Tricks](link)
+
+- **SQLcl**: Dive into the versatile command-line interface for Oracle Database with SQLcl. Experience its advanced features and customization options for enhanced SQL scripting and execution.
+  - [Official Documentation](link)
+  - [Installation Guide](link)
+  - [Customization Tips](link)
+
+## 1.1. SQL Tips
+
+Stay updated with fortnightly SQL tips to sharpen your SQL skills and discover new techniques for database querying and management.
+
+- **Tip 1: [Tip Title]** - [Description/Explanation]
+- **Tip 2: [Tip Title]** - [Description/Explanation]
+- ...
+
+## 1.2. Articles/Blogs
+
+Explore insightful articles and blogs written by Oracle SQL and Database advocates, product managers, and experts to stay informed about the latest trends, best practices, and innovations in SQL and database management.
+
+- [Article 1 Title](link) - [Brief Description]
+- [Article 2 Title](link) - [Brief Description]
+- ...
+
+## 1.3. SQL Examples
+
+Access a repository of SQL examples to learn practical applications of SQL in various scenarios. Explore query samples, optimization techniques, and troubleshooting solutions to enhance your SQL proficiency.
+
+- **Example 1: [Example Title]** - [Description/Explanation]
+- **Example 2: [Example Title]** - [Description/Explanation]
+- ...
+
+## 1.4. SQL Clue Card
+
+Get quick access to essential SQL commands, syntax, and tips with the SQL Clue Card. Print it out or keep it handy for reference during your SQL scripting sessions.
+
+- [Download SQL Clue Card](link)
+
+# 2. SQLcl
+
+Discover the advanced features and functionalities of SQLcl, Oracle's command-line interface for Oracle Database. From customizable prompts to enhanced scripting capabilities, SQLcl offers a versatile environment for SQL developers and administrators.
+
+## 2.1. Features of SQLcl
+
+- **Customizable Prompt**: Personalize your SQLcl environment with custom prompts to display relevant information and enhance readability.
+- **Scripting Enhancements**: Leverage SQLcl's scripting capabilities to automate database tasks, generate reports, and streamline workflows.
+- **Integrated Command-line Editing**: Take advantage of built-in command-line editing features for efficient SQL input and editing.
+
+## 2.2.  Resources
+
+- [Official Documentation](https://www.oracle.com/es/database/sqldeveloper/technologies/sqlcl/)
+- [Installation Guide](https://docs.oracle.com/en/database/oracle/apex/23.2/aeadm/downloading-and-installing-sqlcl.html)
+- [Tips and Tricks](link)
+
+## 2.3. Getting Started
+
+Ready to explore SQLcl? Follow these steps to install SQLcl and start leveraging its powerful features for SQL scripting and database management.
 
+1. [Download SQLcl](link) and follow the installation instructions for your operating system.
+2. Configure SQLcl settings and customize your environment according to your preferences.
+3. Explore SQLcl commands and features to familiarize yourself with its capabilities.
+4. Start scripting and executing SQL commands with ease using SQLcl's intuitive interface.
 
-# Reusable Assets Overview
+# 3. Reusable Assets Overview
 
 TBD
 
diff --git a/data-platform/modernise/database-upgrade/README.md b/data-platform/modernise/database-upgrade/README.md
@@ -0,0 +1,29 @@
+# Database Upgrade
+ 
+This page will describe the various upgrade methodologies for both on-premises databases as well as for databases residing in OCI.
+
+Reviewed: 04.04.2024
+ 
+# Table of Contents
+ 
+1. [Team Publications](#team-publications)
+2. [Useful Links](#useful-links)
+ 
+# Team Publications
+ 
+- [Upgrade Oracle Database EE from 12.2 to 19.3 using AutoUpgrade tool](https://mihaicosteanu.wordpress.com/2024/03/28/upgrade-oracle-database-ee-from-12-2-to-19-3-using-autoupgrade-tool/)
+    - Step-by-step guide by Mihai Costeanu demonstrating the upgrade of a 12.2 Enterprise Edition database to version 19.3 via the AutoUpgrade tool
+
+# Useful Links
+- [Database Server Upgrade/Downgrade Compatibility Matrix on MOS (Doc ID 551141.1)](https://support.oracle.com/epmos/faces/DocumentDisplay?id=551141.1)
+- [LiveLabs: Hitchhiker's Guide for Upgrading to Oracle Database 19c & 23c](https://apexapps.oracle.com/pls/apex/r/dbpm/livelabs/view-workshop?wid=606&clear=RR,180)
+- [Mike Dietrich's Personal Platform](https://mikedietrichde.com/)
+- [Daniel Overby Hansen's Personal Platform](https://dohdatabase.com/)
+
+# License
+ 
+Copyright (c) 2024 Oracle and/or its affiliates.
+ 
+Licensed under the Universal Permissive License (UPL), Version 1.0.
+ 
+See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.
