Merge pull request #269911 from sreekzz/patch-15

Flink updates Batch 2

Author: ttorble

articles/hdinsight-aks/flink/change-data-capture-connectors-for-apache-flink.md

@@ -3,7 +3,7 @@ title: How to perform Change Data Capture of SQL Server with Apache Flink® Data
 description: Learn how to perform Change Data Capture of SQL Server with Apache Flink® DataStream API and DataStream Source.
 ms.service: hdinsight-aks
 ms.topic: how-to
-ms.date: 08/29/2023
+ms.date: 03/22/2024
 ---
 
 # Change Data Capture of SQL Server with Apache Flink® DataStream API and DataStream Source on HDInsight on AKS
@@ -155,10 +155,10 @@ In the below snippet, we use HDInsight Kafka 2.4.1. Based on your usage, update
      <properties>
          <maven.compiler.source>1.8</maven.compiler.source>
          <maven.compiler.target>1.8</maven.compiler.target>
-         <flink.version>1.16.0</flink.version>
+         <flink.version>1.17.0</flink.version>
          <java.version>1.8</java.version>
          <scala.binary.version>2.12</scala.binary.version>
-         <kafka.version>2.4.1</kafka.version> // Replace with 3.2 if you're using HDInsight Kafka 3.2
+         <kafka.version>3.2.0</kafka.version> // Replace with 3.2 if you're using HDInsight Kafka 3.2
      </properties>
      <dependencies>
          <dependency>
@@ -284,6 +284,19 @@ public class mssqlSinkToKafka {
 }
 ```
 
+### Submit job to Flink
+
+* On Webssh pod
+
+  ```
+  bin/flink run -c contoso.example.mssqlSinkToKafka -j FlinkSQLServerCDCDemo-1.0-SNAPSHOT.jar 
+  Job has been submitted with JobID abccf644ae13a8028d7e232b85bd507f
+  ```
+* On Flink UI make the following change.
+
+  :::image type="content" source="./media/change-data-capture-connectors-for-apache-flink/flink-ui.png" alt-text="Screenshot showing the Flink UI.":::
+
+
 ### Validation
 
 - Insert four rows into table order on sqlserver, then check on Kafka
@@ -306,7 +319,7 @@ public class mssqlSinkToKafka {
 
     :::image type="content" source="./media/change-data-capture-connectors-for-apache-flink/check-changes-on-kafka-for-id-107.png" alt-text="Screenshot showing changes in Kafka for updated ID 107.":::
 
-  -  Delete `product_id=107` on sqlserver
+  -  Delete `product_id=107` on 
 
      :::image type="content" source="./media/change-data-capture-connectors-for-apache-flink/delete-product-id-107-on-sql-server.png" alt-text="Screenshot showing how to delete product ID 107.":::
 

articles/hdinsight-aks/flink/datastream-api-mongodb.md

@@ -1,9 +1,9 @@
 ---
 title: Use DataStream API for MongoDB as a source and sink with Apache Flink®
-description: Learn how to use Apache Flink® DataStream API on HDInsight on AKS for MongoDB as a source and sink
+description: Learn how to use Apache Flink® DataStream API on HDInsight on AKS for MongoDB as a source and sink.
 ms.service: hdinsight-aks
 ms.topic: how-to
-ms.date: 10/30/2023
+ms.date: 03/22/2024
 ---
 
 # Use Apache Flink® DataStream API on HDInsight on AKS for MongoDB as a source and sink  
@@ -12,24 +12,24 @@ ms.date: 10/30/2023
 
 Apache Flink provides a MongoDB connector for reading and writing data from and to MongoDB collections with at-least-once guarantees.
 
-This example demonstrates on how to use Apache Flink 1.16.0 on HDInsight on AKS along with your existing MongoDB as Sink and Source with Flink DataStream API MongoDB connector.
+This example demonstrates on how to use Apache Flink 1.17.0 on HDInsight on AKS along with your existing MongoDB as Sink and Source with Flink DataStream API MongoDB connector.
 
-MongoDB is a non-relational document database that provides support for JSON-like storage that helps store complex structures easily.
+MongoDB is a nonrelational document database that provides support for JSON-like storage that helps store complex structures easily.
 
 In this example, you learn how to use MongoDB to source and sink with DataStream API.
 
 ## Prerequisites
 
-* [Flink cluster 1.16.0 on HDInsight on AKS](../flink/flink-create-cluster-portal.md)
+* [HDInsight on AKS - Flink 1.17.0 Cluster](../flink/flink-create-cluster-portal.md)
 * For this demonstration, use a Window VM as maven project develop env in the same VNET as HDInsight on AKS.
 * We use the [MongoDB Connector](https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/connectors/datastream/mongodb/)
 * For this demonstration, use an Ubuntu VM in the same VNET as HDInsight on AKS, install a MongoDB on this VM.
 
 ## Installation of MongoDB on Ubuntu VM
 
-[Install MongoDB on Ubuntu](https://www.mongodb.com/docs/manual/tutorial/install-mongodb-on-ubuntu/)
+[Install MongoDB on Ubuntu](https://www.mongodb.com/docs/manual/tutorial/install-mongodb-on-ubuntu/).
 
-[MongoDB Shell commands](https://www.mongodb.com/docs/mongodb-shell/run-commands/)
+[MongoDB Shell commands](https://www.mongodb.com/docs/mongodb-shell/run-commands/).
 
 **Prepare MongoDB environment**:
 ```
@@ -97,7 +97,7 @@ net:
 
 ## Get started
 
-### Create a maven project on IdeaJ, to prepare the pom.xml for MongoDB Collection
+### Create a maven project on IdeaJ to prepare the pom.xml for MongoDB Collection
 
 ``` xml
 <?xml version="1.0" encoding="UTF-8"?>
@@ -300,7 +300,7 @@ public class Event {
 ```
 ### Use MongoDB as a source and sink to ADLS Gen2
 
-Write a program for MongoDB as a source and sink to ADLS Gen2
+Write a program for MongoDB as a source and sink to ADLS Gen2.
 
 **MongoDBSourceDemo.java**
 ``` java
@@ -373,7 +373,7 @@ public class MongoDBSourceDemo {
 ```
 ### Package the maven jar, and submit to Apache Flink UI
 
-Package the maven jar, upload it to Storage and then wget it to [Flink CLI](./flink-web-ssh-on-portal-to-flink-sql.md) or directly upload to Flink UI to run.
+Package the maven jar, and upload it to Storage and then wget it to [Flink CLI](./flink-web-ssh-on-portal-to-flink-sql.md) or directly upload to Flink UI to run.
 
 :::image type="content" source="./media/datastream-api-mongodb/step-3-1-maven-jar-upload-abfs.png" alt-text="Screenshot displays how to upload package to storage." border="true" lightbox="./media/datastream-api-mongodb/step-3-1-maven-jar-upload-abfs.png":::
 

articles/hdinsight-aks/flink/fabric-lakehouse-flink-datastream-api.md

@@ -3,7 +3,7 @@ title: Microsoft Fabric with Apache Flink® in HDInsight on AKS
 description: An introduction to lakehouse on Microsoft Fabric with Apache Flink® on HDInsight on AKS
 ms.service: hdinsight-aks
 ms.topic: conceptual
-ms.date: 08/29/2023
+ms.date: 03/23/2024
 ---
 # Connect to OneLake in Microsoft Fabric with HDInsight on AKS cluster for Apache Flink®
 
@@ -56,7 +56,7 @@ This step illustrates, that we package dependencies needed for onelakeDemo
     <properties>
         <maven.compiler.source>1.8</maven.compiler.source>
         <maven.compiler.target>1.8</maven.compiler.target>
-        <flink.version>1.16.0</flink.version>
+        <flink.version>1.17.0</flink.version>
         <java.version>1.8</java.version>
         <scala.binary.version>2.12</scala.binary.version>
     </properties>
@@ -202,13 +202,17 @@ public class onelakeDemo {
     }
 }
 ```
-### Package the jar and submit to Flink
+### Package the jar and upload it into Webssh and submit the job:
 
-Here, we use the packaged jar and submit to Flink cluster in HDInsight on AKS
+`bin/flink run -c contoso.example.onelakeDemo -j OneLakeDemo-1.0-SNAPSHOT.jar`
 
-:::image type="content" source="./media/fabric-lakehouse-flink-datastream-api/jar-submit-flink-step-1.png" alt-text="Screenshot showing How to submit packaged jar and submitting to Flink cluster - step 1." border="true" lightbox="./media/fabric-lakehouse-flink-datastream-api/jar-submit-flink-step-1.png":::
+:::image type="content" source="./media/fabric-lakehouse-flink-datastream-api/package-the-jar-file.png" alt-text="Screenshot showing how to package the jar file." border="true" lightbox="./media/fabric-lakehouse-flink-datastream-api/package-the-jar-file.png":::
+
+Check Job running on Flink UI:
+
+
+:::image type="content" source="./media/fabric-lakehouse-flink-datastream-api/check-job-runs-on-flink-ui.png" alt-text="Screenshot showing how to check job runs on Flink UI." border="true" lightbox="./media/fabric-lakehouse-flink-datastream-api/check-job-runs-on-flink-ui.png":::
 
-:::image type="content" source="./media/fabric-lakehouse-flink-datastream-api/jar-submit-flink-step-2.png" alt-text="Screenshot showing How to submit packaged jar and submitting to Flink cluster - step 2." border="true" lightbox="./media/fabric-lakehouse-flink-datastream-api/jar-submit-flink-step-2.png":::
 
 ### Results on Microsoft Fabric