Skip to content

Commit 091fb17

Browse files
authored
Updated flink as 1.17
Updated flink as 1.17
1 parent 0d9767b commit 091fb17

File tree

1 file changed

+7
-5
lines changed

1 file changed

+7
-5
lines changed

articles/hdinsight-aks/flink/flink-catalog-iceberg-hive.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: Table API and SQL - Use Iceberg Catalog type with Hive in Apache Flink®
33
description: Learn how to create Iceberg Catalog in Apache Flink® on HDInsight on AKS
44
ms.service: hdinsight-aks
55
ms.topic: how-to
6-
ms.date: 10/27/2023
6+
ms.date: 3/28/2024
77
---
88

99
# Create Iceberg Catalog in Apache Flink® on HDInsight on AKS
@@ -23,8 +23,10 @@ In this article, we learn how to use Iceberg Table managed in Hive catalog, with
2323
Once you launch the Secure Shell (SSH), let us start downloading the dependencies required to the SSH node, to illustrate the Iceberg table managed in Hive catalog.
2424

2525
```
26-
wget https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-flink-runtime-1.16/1.3.0/iceberg-flink-runtime-1.16-1.3.0.jar -P $FLINK_HOME/lib
26+
wget https://repo1.maven.org/maven2/org/apache/iceberg/iceberg-flink-runtime-1.17/1.4.0/iceberg-flink-runtime-1.17-1.4.0.jar -P $FLINK_HOME/lib
2727
wget https://repo1.maven.org/maven2/org/apache/parquet/parquet-column/1.12.2/parquet-column-1.12.2.jar -P $FLINK_HOME/lib
28+
wget https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs-client/3.3.4/hadoop-hdfs-client-3.3.4.jar -P $FLINK_HOME
29+
export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$FLINK_HOME/hadoop-hdfs-client-3.3.4.jar
2830
```
2931

3032
## Start the Apache Flink SQL Client
@@ -43,7 +45,7 @@ With the following steps, we illustrate how you can create Flink-Iceberg Catalog
4345
'uri'='thrift://hive-metastore:9083',
4446
'clients'='5',
4547
'property-version'='1',
46-
'warehouse'='abfs://container@storage_account.dfs.core.windows.net/ieberg-output');
48+
'warehouse'='abfs://container@storage_account.dfs.core.windows.net/iceberg-output');
4749
```
4850
> [!NOTE]
4951
> - In the above step, the container and storage account *need not be same* as specified during the cluster creation.
@@ -56,8 +58,8 @@ With the following steps, we illustrate how you can create Flink-Iceberg Catalog
5658
#### Add dependencies to server classpath
5759

5860
```sql
59-
ADD JAR '/opt/flink-webssh/lib/iceberg-flink-runtime-1.16-1.3.0.jar';
60-
ADD JAR '/opt/flink-webssh/lib/parquet-column-1.12.2.jar';
61+
ADD JAR '/opt/flink-webssh/lib/iceberg-flink-runtime-1.17-1.4.0.jar';
62+
ADD JAR '/opt/flink-webssh/lib/parquet-column-1.12.2.jar';
6163
```
6264
#### Create Database
6365

0 commit comments

Comments
 (0)