Merge pull request #1119 from oracle-devrel/bp_opensource_data_platform

changes made

Author: AlexanderHodicke

data-platform/open-source-data-platforms/oci-cache/README.md

@@ -1,8 +1,8 @@
-# OCI Cache with Redis
+# OCI Cache (Redis/Valkey)
 OCI Cache with Redis is a comprehensive, managed in-memory caching solution built on the foundation of open source Redis. 
 This fully managed service accelerates data reads and writes, significantly enhancing application response times and database performance to provide an improved customer experience.
 
-Reviewed: 04.06.2024
+Reviewed: 05.06.2024
 
 # Table of Contents
 

data-platform/open-source-data-platforms/oci-data-flow/README.md

@@ -1,7 +1,7 @@
 # OCI Data Flow
 Oracle Cloud Infrastructure (OCI) Data Flow is a fully managed Apache Spark service that performs processing tasks on extremely large datasets—without infrastructure to deploy or manage. Developers can also use Spark Streaming to perform cloud ETL on their continuously produced streaming data. This enables rapid application delivery because developers can focus on app development, not infrastructure management
 
-Reviewed: 04.06.2024
+Reviewed: 05.06.2024
 
 # Table of Contents
 
@@ -23,10 +23,17 @@ Reviewed: 04.06.2024
 
 # Reusable Assets
 
-- [Build and deploy OCI DataFlow application from OCI Data Science - Example](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/build-and-deploy-app-from-oci-ds)
+- [Build and deploy OCI DataFlow application using OCI Data Science - Example](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/build-and-deploy-app-from-oci-ds)
+When using OCI Data Science to build and deploy an OCI Data Flow application. Using the notebook sessions, you can either directly interact with an OCI Data Flow cluster in-line and test your Spark code, and afterwards easily deploy and run the OCI Data Flow application.
+
 - [Load data from OCI Data Flow into Autonomous Database](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw)
+When you are planning to use an Autonomous Database as a source and/or Autonomous Database as a target when running an OCI Data Flow application.
+
 - [Connect to Salesforce using OCI Data Flow](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/salesforce)
+When you are looking to use Salesforce data in your OCI Data Flow application, you can use the script to establish the connection and query relevant Salesforce data.
+
 - [Run OCI Data Flow from OCI Functions](https://github.com/oracle-devrel/technology-engineering/tree/main/data-platform/open-source-data-platforms/oci-data-flow/code-examples/run-from-functions)
+When in your overall flow OCI Functions are used (e.g., based on an event) to start an OCI Data Flow job run.
 
 # License
 

data-platform/open-source-data-platforms/oci-data-flow/code-examples/build-and-deploy-app-from-oci-ds/README.md

@@ -1,16 +1,15 @@
-# Build and Deploy App from OCI DS
-
-
+# Build and Deploy an OCI Data Flow application using OCI Data Science
 
 Reviewed: 04.06.2024
 
 # When to use this asset?
 
-To deploy a dataflow example, using OCI Data Science.
+When using OCI Data Science to build and deploy an OCI Data Flow application. Using the notebook sessions, you can either directly interact with an OCI Data Flow cluster in-line and test your Spark code, and afterwards easily deploy and run the OCI Data Flow application.
 
 # How to use this asset?
 
-Please use the notebook under the files folder.
+- Upload the notebook in an OCI Data Science notebook session, and run the notebook.
+- Upload the .py file in an object storage bucket to be used as the script in the application.
 
 # License
 

data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw/LICENSE

@@ -0,0 +1,35 @@
+Copyright (c) 2024 Oracle and/or its affiliates.
+
+The Universal Permissive License (UPL), Version 1.0
+
+Subject to the condition set forth below, permission is hereby granted to any
+person obtaining a copy of this software, associated documentation and/or data
+(collectively the "Software"), free of charge and under any and all copyright
+rights in the Software, and any and all patent rights owned or freely
+licensable by each licensor hereunder covering either (i) the unmodified
+Software as contributed to or provided by such licensor, or (ii) the Larger
+Works (as defined below), to deal in both
+
+(a) the Software, and
+(b) any piece of software and/or hardware listed in the lrgrwrks.txt file if
+one is included with the Software (each a "Larger Work" to which the Software
+is contributed by such licensors),
+
+without restriction, including without limitation the rights to copy, create
+derivative works of, display, perform, and distribute the Software and make,
+use, sell, offer for sale, import, export, have made, and have sold the
+Software and the Larger Work(s), and to sublicense the foregoing rights on
+either these or other terms.
+
+This license is subject to the following condition:
+The above copyright notice and either this complete permission notice or at
+a minimum a reference to the UPL must be included in all copies or
+substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw/README.md

@@ -0,0 +1,20 @@
+# Load data from Autonomous Database into OCI Data Flow 
+
+Reviewed: 05.06.2024
+
+# When to use this asset?
+
+When you are planning to use an Autonomous Database as a source and/or Autonomous Database as a target when running an OCI Data Flow application.
+
+# How to use this asset?
+
+- Add the load-data-to-adw.py file to your main script
+- Change the credentials and make sure you are referencing the correct tables/views
+
+# License
+
+Copyright (c) 2023 Oracle and/or its affiliates.
+
+Licensed under the Universal Permissive License (UPL), Version 1.0.
+
+See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.

data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw/load-data-to-adw.py renamed to data-platform/open-source-data-platforms/oci-data-flow/code-examples/load-data-to-adw/files/load-data-to-adw.py

@@ -0,0 +1,35 @@
+Copyright (c) 2024 Oracle and/or its affiliates.
+
+The Universal Permissive License (UPL), Version 1.0
+
+Subject to the condition set forth below, permission is hereby granted to any
+person obtaining a copy of this software, associated documentation and/or data
+(collectively the "Software"), free of charge and under any and all copyright
+rights in the Software, and any and all patent rights owned or freely
+licensable by each licensor hereunder covering either (i) the unmodified
+Software as contributed to or provided by such licensor, or (ii) the Larger
+Works (as defined below), to deal in both
+
+(a) the Software, and
+(b) any piece of software and/or hardware listed in the lrgrwrks.txt file if
+one is included with the Software (each a "Larger Work" to which the Software
+is contributed by such licensors),
+
+without restriction, including without limitation the rights to copy, create
+derivative works of, display, perform, and distribute the Software and make,
+use, sell, offer for sale, import, export, have made, and have sold the
+Software and the Larger Work(s), and to sublicense the foregoing rights on
+either these or other terms.
+
+This license is subject to the following condition:
+The above copyright notice and either this complete permission notice or at
+a minimum a reference to the UPL must be included in all copies or
+substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

data-platform/open-source-data-platforms/oci-data-flow/code-examples/run-from-functions/LICENSE

@@ -0,0 +1,20 @@
+# Triggering OCI Data Flow from OCI Functions
+
+Reviewed: 05.06.2024
+
+# When to use this asset?
+
+When in your overall flow OCI Functions are used (e.g., based on an event) to start an OCI Data Flow job run.
+
+# How to use this asset?
+
+- Add the run-oci-data-flow-from_function.py script to your main script
+- Review the script and make the appropriate changes, like changing the application OCID and compartment OCID
+
+# License
+
+Copyright (c) 2023 Oracle and/or its affiliates.
+
+Licensed under the Universal Permissive License (UPL), Version 1.0.
+
+See [LICENSE](https://github.com/oracle-devrel/technology-engineering/blob/main/LICENSE) for more details.

data-platform/open-source-data-platforms/oci-data-flow/code-examples/run-from-functions/README.md

@@ -0,0 +1,35 @@
+Copyright (c) 2024 Oracle and/or its affiliates.
+
+The Universal Permissive License (UPL), Version 1.0
+
+Subject to the condition set forth below, permission is hereby granted to any
+person obtaining a copy of this software, associated documentation and/or data
+(collectively the "Software"), free of charge and under any and all copyright
+rights in the Software, and any and all patent rights owned or freely
+licensable by each licensor hereunder covering either (i) the unmodified
+Software as contributed to or provided by such licensor, or (ii) the Larger
+Works (as defined below), to deal in both
+
+(a) the Software, and
+(b) any piece of software and/or hardware listed in the lrgrwrks.txt file if
+one is included with the Software (each a "Larger Work" to which the Software
+is contributed by such licensors),
+
+without restriction, including without limitation the rights to copy, create
+derivative works of, display, perform, and distribute the Software and make,
+use, sell, offer for sale, import, export, have made, and have sold the
+Software and the Larger Work(s), and to sublicense the foregoing rights on
+either these or other terms.
+
+This license is subject to the following condition:
+The above copyright notice and either this complete permission notice or at
+a minimum a reference to the UPL must be included in all copies or
+substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.