You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/storm/apache-storm-overview.md
+16-34Lines changed: 16 additions & 34 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,20 +2,19 @@
2
2
title: What is Apache Storm - Azure HDInsight
3
3
description: Apache Storm allows you to process streams of data in real time. Azure HDInsight allows you to easily create Storm clusters on the Azure cloud. With Visual Studio, you can create Storm solutions using C#, and then deploy to your HDInsight Storm clusters.
4
4
author: hrasheed-msft
5
+
ms.author: hrasheed
5
6
ms.reviewer: jasonh
6
-
keywords: apache storm use cases,storm cluster,what is apache storm
7
-
8
7
ms.service: hdinsight
9
-
ms.custom: hdinsightactive,hdiseo17may2017
10
8
ms.topic: overview
11
-
ms.date: 06/12/2019
12
-
ms.author: hrasheed
9
+
ms.custom: hdinsightactive,hdiseo17may2017
10
+
ms.date: 03/02/2020
11
+
13
12
#Customer intent: As a developer, I want to understand how Storm on HDInsight is different from Storm on other platforms.
14
13
---
15
14
16
15
# What is Apache Storm on Azure HDInsight?
17
16
18
-
[Apache Storm](https://storm.apache.org/) is a distributed, fault-tolerant, open-source computation system. You can use Storm to process streams of data in real time with [Apache Hadoop](https://hadoop.apache.org/). Storm solutions can also provide guaranteed processing of data, with the ability to replay data that was not successfully processed the first time.
17
+
[Apache Storm](https://storm.apache.org/) is a distributed, fault-tolerant, open-source computation system. You can use Storm to process streams of data in real time with [Apache Hadoop](https://hadoop.apache.org/). Storm solutions can also provide guaranteed processing of data, with the ability to replay data that wasn't successfully processed the first time.
19
18
20
19
## Why use Apache Storm on HDInsight?
21
20
@@ -31,13 +30,9 @@ Storm on HDInsight provides the following features:
31
30
32
31
* Supports the Trident Java interface. You can create Storm topologies that support exactly once processing of messages, transactional datastore persistence, and a set of common stream analytics operations.
33
32
34
-
***Dynamic scaling**: You can add or remove worker nodes with no impact to running Storm topologies.
35
-
36
-
* You must deactivate and reactivate running topologies to take advantage of new nodes added through scaling operations.
33
+
***Dynamic scaling**: You can add or remove worker nodes with no impact to running Storm topologies. You must deactivate and reactivate running topologies to take advantage of new nodes added through scaling operations.
37
34
38
-
***Create streaming pipelines using multiple Azure services**: Storm on HDInsight integrates with other Azure services such as Event Hubs, SQL Database, Azure Storage, and Azure Data Lake Storage.
39
-
40
-
For an example solution that integrates with Azure services, see [Process events from Event Hubs with Apache Storm on HDInsight](https://github.com/Azure-Samples/hdinsight-java-storm-eventhub).
35
+
***Create streaming pipelines using multiple Azure services**: Storm on HDInsight integrates with other Azure services such as Event Hubs, SQL Database, Azure Storage, and Azure Data Lake Storage. For an example solution that integrates with Azure services, see [Process events from Event Hubs with Apache Storm on HDInsight](https://github.com/Azure-Samples/hdinsight-java-storm-eventhub).
41
36
42
37
For a list of companies that are using Apache Storm for their real-time analytics solutions, see [Companies using Apache Storm](https://storm.apache.org/Powered-By.html).
43
38
@@ -69,19 +64,12 @@ You can create a new Storm cluster on HDInsight in minutes. For more information
69
64
70
65
## Ease of use
71
66
72
-
*__Secure Shell (SSH) connectivity__: You can access the head nodes of your Storm cluster over the Internet by using SSH. You can run commands directly on your cluster by using SSH.
73
-
74
-
For more information, see [Use SSH with HDInsight](../hdinsight-hadoop-linux-use-ssh-unix.md).
75
-
76
-
*__Web connectivity__: All HDInsight clusters provide the Ambari web UI. You can easily monitor, configure, and manage services on your cluster by using the Ambari web UI. Storm clusters also provide the Storm UI. You can monitor and manage running Storm topologies from your browser by using the Storm UI.
77
-
78
-
For more information, see the [Manage HDInsight using the Apache Ambari Web UI](../hdinsight-hadoop-manage-ambari.md) and [Monitor and manage using the Apache Storm UI](apache-storm-deploy-monitor-topology-linux.md#monitor-and-manage-a-topology-using-the-storm-ui) documents.
79
-
80
-
*__Azure PowerShell and Azure Classic CLI__: PowerShell and classic CLI both provide command-line utilities that you can use from your client system to work with HDInsight and other Azure services.
81
-
82
-
*__Visual Studio integration__: Azure Data Lake Tools for Visual Studio include project templates for creating C# Storm topologies by using the SCP.NET framework. Data Lake Tools also provide tools to deploy, monitor, and manage solutions with Storm on HDInsight.
83
-
84
-
For more information, see [Develop C# Storm topologies with the HDInsight Tools for Visual Studio](apache-storm-develop-csharp-visual-studio-topology.md).
67
+
|Use |Description |
68
+
|---|---|
69
+
|Secure Shell (SSH) connectivity|You can access the head nodes of your Storm cluster over the Internet by using SSH. You can run commands directly on your cluster by using SSH. For more information, see [Use SSH with HDInsight](../hdinsight-hadoop-linux-use-ssh-unix.md).|
70
+
|Web connectivity|All HDInsight clusters provide the Ambari web UI. You can easily monitor, configure, and manage services on your cluster by using the Ambari web UI. Storm clusters also provide the Storm UI. You can monitor and manage running Storm topologies from your browser by using the Storm UI. For more information, see the [Manage HDInsight using the Apache Ambari Web UI](../hdinsight-hadoop-manage-ambari.md) and [Monitor and manage using the Apache Storm UI](apache-storm-deploy-monitor-topology-linux.md#monitor-and-manage-a-topology-using-the-storm-ui) documents.|
71
+
|Azure PowerShell and Azure CLI|PowerShell and Azure CLI both provide command-line utilities that you can use from your client system to work with HDInsight and other Azure services.|
72
+
|Visual Studio integration|Azure Data Lake Tools for Visual Studio include project templates for creating C# Storm topologies by using the SCP.NET framework. Data Lake Tools also provide tools to deploy, monitor, and manage solutions with Storm on HDInsight. For more information, see [Develop C# Storm topologies with the HDInsight Tools for Visual Studio](apache-storm-develop-csharp-visual-studio-topology.md).|
85
73
86
74
## Integration with other Azure services
87
75
@@ -97,9 +85,7 @@ You can create a new Storm cluster on HDInsight in minutes. For more information
97
85
98
86
## Support
99
87
100
-
Storm on HDInsight comes with full enterprise-level continuous support. Storm on HDInsight also has an SLA of 99.9 percent. That means Microsoft guarantees that a Storm cluster has external connectivity at least 99.9 percent of the time.
101
-
102
-
For more information, see [Azure support](https://azure.microsoft.com/support/options/).
88
+
Storm on HDInsight comes with full enterprise-level continuous support. Storm on HDInsight also has an SLA of 99.9 percent. That means Microsoft guarantees that a Storm cluster has external connectivity at least 99.9 percent of the time. For more information, see [Azure support](https://azure.microsoft.com/support/options/).
103
89
104
90
## Apache Storm use cases
105
91
@@ -117,9 +103,7 @@ For information about real-world scenarios, see the [How companies are using Apa
117
103
118
104
## Development
119
105
120
-
.NET developers can design and implement topologies in C# by using Data Lake Tools for Visual Studio. You can also create hybrid topologies that use Java and C# components.
121
-
122
-
For more information, see [Develop C# topologies for Apache Storm on HDInsight using Visual Studio](apache-storm-develop-csharp-visual-studio-topology.md).
106
+
.NET developers can design and implement topologies in C# by using Data Lake Tools for Visual Studio. You can also create hybrid topologies that use Java and C# components. For more information, see [Develop C# topologies for Apache Storm on HDInsight using Visual Studio](apache-storm-develop-csharp-visual-studio-topology.md).
123
107
124
108
You can also develop Java solutions by using the IDE of your choice. For more information, see [Develop Java topologies for Apache Storm on HDInsight](apache-storm-develop-java-topology.md).
125
109
@@ -129,9 +113,7 @@ Python can also be used to develop Storm components. For more information, see [
129
113
130
114
### Guaranteed message processing
131
115
132
-
Apache Storm can provide different levels of guaranteed message processing. For example, a basic Storm application can guarantee at-least-once processing, and [Trident](https://storm.apache.org/releases/current/Trident-API-Overview.html) can guarantee exactly once processing.
133
-
134
-
For more information, see [Guarantees on data processing](https://storm.apache.org/about/guarantees-data-processing.html) at apache.org.
116
+
Apache Storm can provide different levels of guaranteed message processing. For example, a basic Storm application can guarantee at-least-once processing, and [Trident](https://storm.apache.org/releases/current/Trident-API-Overview.html) can guarantee exactly once processing. For more information, see [Guarantees on data processing](https://storm.apache.org/about/guarantees-data-processing.html) at apache.org.
0 commit comments