Skip to content

Commit 949ff38

Browse files
author
Sreekanth Iyer (Ushta Te Consultancy Services)
committed
Improved correctness score
1 parent 101b5bd commit 949ff38

File tree

1 file changed

+13
-12
lines changed

1 file changed

+13
-12
lines changed

articles/hdinsight-aks/flink/sink-kafka-to-kibana.md

Lines changed: 13 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
---
22
title: Use Elasticsearch along with Apache Flink® on HDInsight on AKS
3-
description: Learn how to use Elasticsearch along Apache Flink® on HDInsight on AKS
3+
description: Learn how to use Elasticsearch along Apache Flink® on HDInsight on AKS.
44
ms.service: hdinsight-aks
55
ms.topic: how-to
6-
ms.date: 10/27/2023
6+
ms.date: 04/04/2024
77
---
88

99
# Using Elasticsearch with Apache Flink® on HDInsight on AKS
@@ -18,7 +18,8 @@ In this article, learn how to Use Elastic along Apache Flink® on HDInsight on A
1818

1919
## Elasticsearch and Kibana
2020

21-
Elasticsearch is a distributed, free and open search and analytics engine for all types of data, including
21+
Elasticsearch is a distributed, free, and open search and analytics engine for all types of data, including.
22+
2223
* Textual
2324
* Numerical
2425
* Geospatial
@@ -27,7 +28,7 @@ Elasticsearch is a distributed, free and open search and analytics engine for al
2728

2829
Kibana is a free and open frontend application that sits on top of the elastic stack, providing search and data visualization capabilities for data indexed in Elasticsearch.
2930

30-
For more information, refer
31+
For more information, see.
3132
* [Elasticsearch](https://www.elastic.co)
3233
* [Kibana](https://www.elastic.co/guide/en/kibana/current/index.html)
3334

@@ -90,7 +91,7 @@ sudo apt install elasticsearch
9091
9192
For installing and configuring Kibana Dashboard, we don’t need to add any other repository because the packages are available through the already added ElasticSearch.
9293
93-
We use the following command to install Kibana
94+
We use the following command to install Kibana.
9495
9596
```
9697
sudo apt install kibana
@@ -111,9 +112,9 @@ sudo apt install kibana
111112
```
112113
### Access the Kibana Dashboard web interface
113114
114-
In order to make Kibana accessible from output, need to set network.host to 0.0.0.0
115+
In order to make Kibana accessible from output, need to set network.host to 0.0.0.0.
115116
116-
configure /etc/kibana/kibana.yml on Ubuntu VM
117+
Configure `/etc/kibana/kibana.yml` on Ubuntu VM
117118
118119
> [!NOTE]
119120
> 10.0.1.4 is a local private IP, that we have used which can be accessed in maven project develop Windows VM. You're required to make modifications according to your network security requirements. We use the same IP later to demo for performing analytics on Kibana.
@@ -129,12 +130,12 @@ elasticsearch.hosts: ["http://10.0.1.4:9200"]
129130
130131
## Prepare Click Events on HDInsight Kafka
131132
132-
We use python output as input to produce the streaming data
133+
We use python output as input to produce the streaming data.
133134
134135
```
135136
sshuser@hn0-contsk:~$ python weblog.py | /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --bootstrap-server wn0-contsk:9092 --topic click_events
136137
```
137-
Now, lets check messages in this topic
138+
Now, lets check messages in this topic.
138139
139140
```
140141
sshuser@hn0-contsk:~$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --bootstrap-server wn0-contsk:9092 --topic click_events
@@ -149,7 +150,7 @@ sshuser@hn0-contsk:~$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.s
149150
150151
## Creating Kafka Sink to Elastic
151152
152-
Let us write maven source code on the Windows VM
153+
Let us write maven source code on the Windows VM.
153154
154155
**Main: kafkaSinkToElastic.java**
155156
``` java
@@ -289,7 +290,7 @@ public class kafkaSinkToElastic {
289290

290291
**Package the jar and submit to Flink to run on WebSSH**
291292

292-
On [Secure Shell for Flink](./flink-web-ssh-on-portal-to-flink-sql.md), you can use the following commands
293+
On [Secure Shell for Flink](./flink-web-ssh-on-portal-to-flink-sql.md), you can use the following commands.
293294

294295
```
295296
msdata@pod-0 [ ~ ]$ ls -l FlinkElasticSearch-1.0-SNAPSHOT.jar
@@ -329,7 +330,7 @@ Job has been submitted with JobID e0eba72d5143cea53bcf072335a4b1cb
329330

330331
## Validation on Apache Flink Job UI
331332

332-
You can find the job in running state on your Flink Web UI
333+
You can find the job in running state on your Flink Web UI.
333334

334335
:::image type="content" source="./media/sink-kafka-to-kibana/flink-elastic-job.png" alt-text="Screenshot showing Kibana UI to start Elasticsearch and Kibana and perform analytics on Kibana." lightbox="./media/sink-kafka-to-kibana/flink-elastic-job.png":::
335336

0 commit comments

Comments
 (0)