You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/benefits-of-migrating-to-hdinsight-40.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,7 +24,7 @@ HDInsight 4.0 has several advantages over HDInsight 3.6. Here's an overview of w
24
24
25
25
## Workloads and Features
26
26
27
-
**Hive**
27
+
**Hive**
28
28
- Advanced features
29
29
- LLAP workload management
30
30
- LLAP Support JDBC, Druid and Kafka connectors
@@ -91,15 +91,15 @@ Assuming you have an external table created using a version of Hive that doesn't
91
91
92
92
Set synchronization of partitions to occur every 10 minutes expressed in seconds: In Ambari > Hive > Configs, `set metastore.partition.management.task.frequency` to 3600 or more.
93
93
94
-
:::image type="content" source="./media/hdinsight-migrate-to-40/ambari-hive-config.png" alt-text="Ambari Hive config file showing the frequency value.":::
94
+
:::image type="content" source="./media/hdinsight-migrate-to-40/ambari-hive-config.png" alt-text=" Screenshot showing Ambari Hive config file with frequency value.":::
95
95
96
96
97
97
> [!WARNING]
98
98
> With the `management.task` running every 10 minutes, there will be pressure on the SQL server DTU.
99
99
>
100
100
You can verify the output from Microsoft Azure portal.
101
101
102
-
:::image type="content" source="./media/hdinsight-migrate-to-40/hive-verify-output.png" alt-text="Verify output from Microsoft Azure portal.":::
Hive drops the metadata and corresponding data in any partition created after the retention period. You express the retention time using a numeral and the following character or characters.
105
105
Hive drops the metadata and corresponding data in any partition created after the retention period. You express the retention time using a numeral and the following character(s).
@@ -185,7 +185,7 @@ The initial implementation introduced in Apache Hive 3.0.0 focuses on introducin
185
185
186
186
More information, see [Hive - Materialized Views - Microsoft Tech Community](https://techcommunity.microsoft.com/t5/analytics-on-azure-blog/hive-materialized-views/ba-p/2502785)
187
187
188
-
###Surrogate Keys
188
+
## Surrogate Keys
189
189
190
190
Use the built-in `SURROGATE_KEY` user-defined function (UDF) to automatically generate numerical Ids for rows as you enter data into a table. The generated surrogate keys can replace wide, multiple composite keys.
191
191
@@ -233,7 +233,7 @@ Hive metastore operation takes much time and thus slow down Hive compilation. In
0 commit comments