Skip to content

Commit 6f00c1a

Browse files
authored
Update apache-kafka-mirroring.md
1 parent 47bcd8c commit 6f00c1a

File tree

1 file changed

+14
-14
lines changed

1 file changed

+14
-14
lines changed

articles/hdinsight/kafka/apache-kafka-mirroring.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ If you need to mirror between Kafka clusters in different networks, there are th
4141
* **Domain names**: If you don't configure your Kafka clusters for IP address advertising, the clusters must be able to connect to each other by using fully qualified domain names (FQDNs). This requires a domain name system (DNS) server in each network that is configured to forward requests to the other networks. When you're creating an Azure virtual network, instead of using the automatic DNS provided with the network, you must specify a custom DNS server and the IP address for the server. After you create the virtual network, you must then create an Azure virtual machine that uses that IP address. Then you install and configure DNS software on it.
4242

4343
> [!IMPORTANT]
44-
> Create and configure the custom DNS server before installing HDInsight into the virtual network. There is no additional configuration required for HDInsight to use the DNS server configured for the Virtual Network.
44+
> Create and configure the custom DNS server before installing HDInsight into the virtual network. There is no additional configuration required for HDInsight to use the DNS server configured for the virtual network.
4545
4646
For more information on connecting two Azure virtual networks, see [Configure a connection](../../vpn-gateway/vpn-gateway-vnet-vnet-rm-ps.md).
4747

@@ -105,7 +105,7 @@ Configure IP advertising to enable a client to connect by using broker IP addres
105105
1. Select **Save**.
106106
1. Select **Restart** > **Confirm Restart All**.
107107
108-
### Record broker IP addresses and ZooKeeper addresses for primary cluster
108+
### Record broker IP addresses and ZooKeeper addresses for the primary cluster
109109
110110
1. Select **Hosts** on the Ambari dashboard.
111111
1. Make a note of the IP addresses for the brokers and ZooKeepers. The broker nodes have **wn** as the first two letters of the host name, and the ZooKeeper nodes have **zk** as the first two letters of the host name.
@@ -116,13 +116,13 @@ Configure IP advertising to enable a client to connect by using broker IP addres
116116
117117
## Create topics
118118
119-
1. Connect to the **primary** cluster by using SSH:
119+
1. Connect to the primary cluster by using SSH:
120120
121121
```bash
122122
123123
```
124124
125-
Replace `sshuser` with the SSH user name used when creating the cluster. Replace `PRIMARYCLUSTER` with the base name used when creating the cluster.
125+
Replace `sshuser` with the SSH user name that you used when creating the cluster. Replace `PRIMARYCLUSTER` with the base name that you used when creating the cluster.
126126
127127
For more information, see [Use SSH with HDInsight](../hdinsight-hadoop-linux-use-ssh-unix.md).
128128
@@ -164,17 +164,17 @@ Configure IP advertising to enable a client to connect by using broker IP addres
164164
165165
## Configure mirroring
166166
167-
1. Connect to the **secondary** cluster by using a different SSH session:
167+
1. Connect to the secondary cluster by using a different SSH session:
168168
169169
```bash
170170
171171
```
172172
173-
Replace `sshuser` with the SSH user name used when creating the cluster. Replace `SECONDARYCLUSTER` with the name used when creating the cluster.
173+
Replace `sshuser` with the SSH user name that you used when creating the cluster. Replace `SECONDARYCLUSTER` with the name that you used when creating the cluster.
174174
175175
For more information, see [Use SSH with HDInsight](../hdinsight-hadoop-linux-use-ssh-unix.md).
176176
177-
1. Use a `consumer.properties` file to configure communication with the **primary** cluster. To create the file, use the following command:
177+
1. Use a `consumer.properties` file to configure communication with the primary cluster. To create the file, use the following command:
178178
179179
```bash
180180
nano consumer.properties
@@ -187,13 +187,13 @@ Configure IP advertising to enable a client to connect by using broker IP addres
187187
group.id=mirrorgroup
188188
```
189189
190-
Replace `PRIMARY_BROKERHOSTS` with the broker host IP addresses from the **primary** cluster.
190+
Replace `PRIMARY_BROKERHOSTS` with the broker host IP addresses from the primary cluster.
191191
192192
This file describes the consumer information to use when reading from the primary Kafka cluster. For more information, see [Consumer Configs](https://kafka.apache.org/documentation#consumerconfigs) at `kafka.apache.org`.
193193
194194
To save the file, press Ctrl+X, press Y, and then press Enter.
195195
196-
1. Before configuring the producer that communicates with the secondary cluster, set up a variable for the broker IP addresses of the **secondary** cluster. Use the following commands to create this variable:
196+
1. Before configuring the producer that communicates with the secondary cluster, set up a variable for the broker IP addresses of the secondary cluster. Use the following commands to create this variable:
197197
198198
```bash
199199
export SECONDARY_BROKERHOSTS='BROKER_IP_ADDRESS1:9092,BROKER_IP_ADDRESS2:9092,BROKER_IP_ADDRESS2:9092'
@@ -203,7 +203,7 @@ Configure IP advertising to enable a client to connect by using broker IP addres
203203
204204
`10.23.0.14:9092,10.23.0.4:9092,10.23.0.12:9092`
205205
206-
1. Use a `producer.properties` file to communicate the **secondary** cluster. To create the file, use the following command:
206+
1. Use a `producer.properties` file to communicate the secondary cluster. To create the file, use the following command:
207207
208208
```bash
209209
nano producer.properties
@@ -256,7 +256,7 @@ Configure IP advertising to enable a client to connect by using broker IP addres
256256
> [!NOTE]
257257
> This article contains references to the term *whitelist*, a term that Microsoft no longer uses. When the term is removed from the software, we'll remove it from this article.
258258
259-
1. From the SSH connection to the **secondary** cluster, use the following command to start the MirrorMaker process:
259+
1. From the SSH connection to the secondary cluster, use the following command to start the MirrorMaker process:
260260
261261
```bash
262262
/usr/hdp/current/kafka-broker/bin/kafka-run-class.sh kafka.tools.MirrorMaker --consumer.config consumer.properties --producer.config producer.properties --whitelist testtopic --num.streams 4
@@ -273,15 +273,15 @@ Configure IP advertising to enable a client to connect by using broker IP addres
273273
274274
The consumer on the secondary node is now waiting to receive messages.
275275
276-
1. From the SSH connection to the **primary** cluster, use the following command to start a producer and send messages to the topic:
276+
1. From the SSH connection to the primary cluster, use the following command to start a producer and send messages to the topic:
277277
278278
```bash
279279
/usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list $PRIMARY_BROKERHOSTS --topic testtopic
280280
```
281281
282-
When you arrive at a blank line with a cursor, type in a few text messages. The messages are sent to the topic on the **primary** cluster. When done, press Ctrl+C to end the producer process.
282+
When you arrive at a blank line with a cursor, type in a few text messages. The messages are sent to the topic on the primary cluster. When done, press Ctrl+C to end the producer process.
283283
284-
1. From the SSH connection to the **secondary** cluster, press Ctrl+C to end the MirrorMaker process. It might take several seconds to end the process. To verify that the messages were replicated to the secondary, use the following command:
284+
1. From the SSH connection to the secondary cluster, press Ctrl+C to end the MirrorMaker process. It might take several seconds to end the process. To verify that the messages were replicated to the secondary, use the following command:
285285
286286
```bash
287287
/usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --bootstrap-server $SECONDARY_BROKERHOSTS --topic testtopic --from-beginning

0 commit comments

Comments
 (0)