Skip to content

Commit 5396f73

Browse files
committed
edits
1 parent e6cb3a8 commit 5396f73

File tree

1 file changed

+19
-14
lines changed

1 file changed

+19
-14
lines changed

articles/hdinsight/kafka/kafka-faq.md

Lines changed: 19 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -6,17 +6,17 @@ ms.author: hrasheed
66
ms.reviewer: jasonh
77
ms.service: hdinsight
88
ms.topic: conceptual
9-
ms.date: 08/09/2019
9+
ms.date: 08/14/2019
1010
---
1111
# Frequently asked questions about Apache Kafka in Azure HDInsight
1212

1313
This article addresses some common questions about using Apache Kafka on Azure HDInsight.
1414

15-
## What Kafka versions are supported by HDInsight
15+
## What Kafka versions are supported by HDInsight?
1616

1717
Our officially supported component versions can be found [here](../hdinsight-component-versioning.md#supported-hdinsight-versions). We recommend always using the latest version to ensure the best possible performance and user experience.
1818

19-
## What resources are provided in an HDInsight Kafka cluster and what resources am I charged for
19+
## What resources are provided in an HDInsight Kafka cluster and what resources am I charged for?
2020

2121
A HDInsight Kafka cluster includes the following resources:
2222

@@ -30,23 +30,23 @@ All of these resources are charged based on our [HDInsight pricing model](https:
3030

3131
For a more detailed description of various node types, see [Azure HDInsight virtual network architecture](../hdinsight-virtual-network-architecture.md). Pricing is based on per minute node usage. Prices vary depending on node size, number of nodes, type of managed disk used, and region.
3232

33-
## Do Apache Kafka APIs work with HDInsight
33+
## Do Apache Kafka APIs work with HDInsight?
3434

3535
Yes, HDInsight uses native Kafka APIs. Your client application code doesn't need to change. See [Tutorial: Use the Apache Kafka Producer and Consumer APIs](./apache-kafka-producer-consumer-api.md) to see how you can use Java-based producer/consumer APIs with your cluster.
3636

37-
## Can I change cluster configurations
37+
## Can I change cluster configurations?
3838

3939
Yes, through the Ambari portal. Each component in the portal has a **configs** section, which can be used to change component configurations. Some changes may require broker restarts.
4040

41-
## What type of authentication does HDInsight Kafka support
41+
## What type of authentication does HDInsight support for Apache Kafka?
4242

4343
Using [Enterprise Security Package (ESP)](../domain-joined/apache-domain-joined-architecture.md), customers can get topic-level security for their Kafka clusters. See [Tutorial: Configure Apache Kafka policies in HDInsight with Enterprise Security Package (Preview)](../domain-joined/apache-domain-joined-run-kafka.md), for more information.
4444

45-
## Is my data encrypted and can I use my own keys
45+
## Is my data encrypted? Can I use my own keys?
4646

47-
All Kafka messages on the managed disks are encrypted with Azure Storage Service Encryption (SSE). Data-in-transit (for example, data being transmitted from clients to brokers and the other way around) isn't encrypted by default. It's possible to encrypt such traffic by setting up SSL on your own. Additionally, HDInsight allows customers to manage their own keys (BYOK) to encrypt the data at rest.
47+
All Kafka messages on the managed disks are encrypted with [Azure Storage Service Encryption (SSE)](../../storage/common/storage-service-encryption.md). Data-in-transit (for example, data being transmitted from clients to brokers and the other way around) isn't encrypted by default. It's possible to encrypt such traffic by [setting up SSL on your own](./apache-kafka-ssl-encryption-authentication.md). Additionally, HDInsight allows customers to manage their own keys to encrypt the data at rest. See [Bring your own key for Apache Kafka on Azure HDInsight](apache-kafka-byok.md), for more information.
4848

49-
## How do I connect clients to my cluster
49+
## How do I connect clients to my cluster?
5050

5151
For Kafka clients to communicate with Kafka brokers, they must be able to reach the brokers over the network. For HDInsight clusters, the Virtual Network (VNet) is the security boundary. Hence, the easiest way to connect clients to your HDInsight cluster is to create clients within the same VNet as the cluster. Other scenarios include:
5252

@@ -56,11 +56,11 @@ For Kafka clients to communicate with Kafka brokers, they must be able to reach
5656

5757
* Creating a public endpoint for your Kafka service – If your enterprise security requirements allow it, you can deploy a public endpoint for your Kafka brokers, or a self-managed open-source REST end point with a public endpoint.
5858

59-
## Can I add more disk space on an existing cluster
59+
## Can I add more disk space on an existing cluster?
6060

6161
To increase the amount of space available for Kafka messages, you can increase the number of nodes. Currently, adding more disks to an existing cluster isn't supported.
6262

63-
## How can I have maximum data durability
63+
## How can I have maximum data durability?
6464

6565
Data durability allows you to achieve the lowest risk of message loss. In order to achieve maximum data durability, we recommend the following settings:
6666

@@ -72,14 +72,19 @@ Data durability allows you to achieve the lowest risk of message loss. In order
7272

7373
Configuring Kafka for higher data consistency affects the availability of brokers to produce requests.
7474

75-
## Can I replicate my data to multiple clusters
75+
## Can I replicate my data to multiple clusters?
7676

7777
Yes, data can be replicated to multiple clusters using Kafka MirrorMaker. Details on setting up MirrorMaker can be found [here](apache-kafka-mirroring.md). Additionally, there are other self-managed open-source technologies and vendors that can help achieve replication to multiple clusters such as [Brooklin](https://github.com/linkedin/Brooklin/).
7878

79-
## Can I upgrade my cluster/ How should I upgrade my cluster
79+
## Can I upgrade my cluster? How should I upgrade my cluster?
8080

8181
We don't currently support in-place cluster version upgrades. To update your cluster to a higher Kafka version, create a new cluster with the version that you want and migrate your Kafka clients to use the new cluster.
8282

83-
## How do I monitor my Kafka cluster
83+
## How do I monitor my Kafka cluster?
8484

8585
Use Azure monitor to analyze your [Kafka logs](./apache-kafka-log-analytics-operations-management.md).
86+
87+
## Next steps
88+
89+
* [Set up Secure Sockets Layer (SSL) encryption and authentication for Apache Kafka in Azure HDInsight](./apache-kafka-ssl-encryption-authentication.md)
90+
* [Use MirrorMaker to replicate Apache Kafka topics with Kafka on HDInsight](./apache-kafka-mirroring.md)

0 commit comments

Comments
 (0)