Skip to content

Commit 841e484

Browse files
committed
Update Iceberg docs
1 parent dfefa4d commit 841e484

File tree

1 file changed

+17
-3
lines changed

1 file changed

+17
-3
lines changed

docs/modules/nifi/pages/usage_guide/writing-to-iceberg-tables.adoc

Lines changed: 17 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -2,13 +2,27 @@
22
:description: Write to Apache Iceberg tables in NiFi using the PutIceberg processor. Supports integration with S3 and Hive Metastore for scalable data handling.
33
:iceberg: https://iceberg.apache.org/
44

5-
WARNING: In NiFi `2.0.0` Iceberg support https://issues.apache.org/jira/browse/NIFI-13938[has been removed].
6-
75
{iceberg}[Apache Iceberg] is a high-performance format for huge analytic tables.
86
Iceberg brings the reliability and simplicity of SQL tables to big data, while making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time.
97

108
NiFi supports a `PutIceberg` processor to add rows to an existing Iceberg table https://issues.apache.org/jira/browse/NIFI-10442[starting from version 1.19.0].
11-
As of NiFi version `1.23.1` only `PutIceberg` is supported, you need to create and compact your tables with other tools such as Trino or Spark (both included in the Stackable Data Platform).
9+
As of NiFi version `2.4.0` only `PutIceberg` is supported, you need to create and compact your tables with other tools such as Trino or Spark (both included in the Stackable Data Platform).
10+
11+
== NiFi 2.x
12+
13+
In NiFi `2.0.0` Iceberg support https://issues.apache.org/jira/browse/NIFI-13938[has been removed] from upstream NiFi.
14+
15+
We forked the `nifi-iceberg-bundle` and made it available at https://github.com/stackabletech/nifi-iceberg-bundle.
16+
Starting with SDP 25.7, we have added the necessary bundle to NiFi by default, you don't need to explicitly add Iceberg support to the Stackable NiFi.
17+
18+
Please read on https://github.com/stackabletech/nifi-iceberg-bundle[its documentation] on how to ingest data into Iceberg tables.
19+
You don't need any special configs on the `NiFiCluster` in case you are using S3 and no Kerberos.
20+
21+
HDFS and Kerberos are also supported, please have a look at the https://github.com/stackabletech/nifi-operator/tree/main/tests/templates/kuttl/iceberg[Iceberg integration test] for that.
22+
23+
== NiFi 1.x
24+
25+
Starting with `1.19.0`, NiFi supports writing to Iceberg tables.
1226

1327
The following example shows an example NiFi setup using the Iceberg integration.
1428

0 commit comments

Comments
 (0)