Skip to content

Commit d68bd57

Browse files
authored
Merge pull request #273959 from sreekzz/patch-38
Replacing Screenshots for App Mode
2 parents 8926c18 + 4456174 commit d68bd57

File tree

7 files changed

+19
-9
lines changed

7 files changed

+19
-9
lines changed
172 KB
Loading
72.3 KB
Loading
57.5 KB
Loading
90.5 KB
Loading

articles/hdinsight-aks/flink/use-flink-to-sink-kafka-message-into-hbase.md

Lines changed: 19 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -3,20 +3,20 @@ title: Write messages to Apache HBase® with Apache Flink® DataStream API
33
description: Learn how to write messages to Apache HBase with Apache Flink DataStream API.
44
ms.service: hdinsight-aks
55
ms.topic: how-to
6-
ms.date: 04/02/2024
6+
ms.date: 05/01/2024
77
---
88

99
# Write messages to Apache HBase® with Apache Flink® DataStream API
1010

1111
[!INCLUDE [feature-in-preview](../includes/feature-in-preview.md)]
1212

13-
In this article, learn how to write messages to HBase with Apache Flink DataStream API
13+
In this article, learn how to write messages to HBase with Apache Flink DataStream API.
1414

1515
## Overview
1616

1717
Apache Flink offers HBase connector as a sink, with this connector with Flink you can store the output of a real-time processing application in HBase. Learn how to process streaming data on HDInsight Kafka as a source, perform transformations, then sink into HDInsight HBase table.
1818

19-
In a real world scenario, this example is a stream analytics layer to realize value from Internet of Things (IOT) analytics, which use live sensor data. The Flink Stream can read data from Kafka topic and write it to HBase table. If there's a real time streaming IOT application, the information can be gathered, transformed, and optimized.
19+
In a real world scenario, this example is a stream analytics layer to realize value from Internet of Things (IOT) analytics, which use live sensor data. The Flink Stream can read data from Kafka article and write it to HBase table. If there's a real time streaming IOT application, the information can be gathered, transformed, and optimized.
2020

2121

2222
## Prerequisites
@@ -346,18 +346,28 @@ public class KafkaSinkToHbase {
346346
}
347347

348348
```
349+
## Submit job
349350

350-
### Submit job on Secure Shell
351+
1. Upload the job Jar to Storage Account associated with the Cluster.
351352

352-
We use [Flink CLI](./flink-web-ssh-on-portal-to-flink-sql.md) from Azure portal to submit jobs.
353+
:::image type="content" source="./media/use-flink-to-sink-kafka-message-into-hbase/upload-jar.png" alt-text="Screenshot showing how to upload jar." lightbox="./media/use-flink-to-sink-kafka-message-into-hbase/upload-jar.png":::
353354

354-
:::image type="content" source="./media/use-flink-to-sink-kafka-message-into-hbase/submit-job-on-web-ssh.png" alt-text="Screenshot showing how to submit job on web ssh." lightbox="./media/use-flink-to-sink-kafka-message-into-hbase/submit-job-on-web-ssh.png":::
355+
1. Add job details in Application Mode tab.
355356

356-
### Monitor job on Flink UI
357+
:::image type="content" source="./media/use-flink-to-sink-kafka-message-into-hbase/application-mode.png" alt-text="Screenshot showing application mode." lightbox="./media/use-flink-to-sink-kafka-message-into-hbase/application-mode.png":::
357358

358-
We can monitor the jobs on Flink Web UI.
359+
> [!NOTE]
360+
> Make sure to add `Hadoop.class.enable` and `classloader.resolve-order` setting.
359361
360-
:::image type="content" source="./media/use-flink-to-sink-kafka-message-into-hbase/check-job-on-flink-ui.png" alt-text="Screenshot showing how to check job on Flink UI." lightbox="./media/use-flink-to-sink-kafka-message-into-hbase/check-job-on-flink-ui.png":::
362+
1. Select **Job Log Aggregation** to store logs in ABFS.
363+
364+
:::image type="content" source="./media/use-flink-to-sink-kafka-message-into-hbase/deployment-type.png" alt-text="Screenshot showing how to submit job on web ssh." lightbox="./media/use-flink-to-sink-kafka-message-into-hbase/deployment-type.png":::
365+
366+
1. Submit the job.
367+
368+
1. You should be able to see the job submitted status here.
369+
370+
:::image type="content" source="./media/use-flink-to-sink-kafka-message-into-hbase/job-status.png" alt-text="Screenshot showing how to check job on Flink UI." lightbox="./media/use-flink-to-sink-kafka-message-into-hbase/job-status.png":::
361371

362372
## Validate HBase table data
363373

0 commit comments

Comments
 (0)