Add Iceberg pages to Cloud #240
Conversation
✅ Deploy Preview for rp-cloud ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
![hyperlint-ai-deprecated[bot]](https://avatars.githubusercontent.com/in/718456?s=60&v=4){kind=small}
PR Change SummaryAdded new pages related to Iceberg integration with Redpanda, enhancing documentation for managing Iceberg topics.
Added Files
How can I customize these reviews?Check out the Hyperlint AI Reviewer docs for more information on how to customize the review. If you just want to ignore it on this PR, you can add the Note specifically for link checks, we only check the first 30 links in a file and we cache the results for several hours (for instance, if you just added a page, you might experience this). Our recommendation is to add |
| :page-beta: true | ||
| :env-byoc: true | ||
|
|
||
| When you access Iceberg topics from a data lakehouse or other Iceberg-compatible tools, how you consume the data depends on the xref:manage:iceberg/about-iceberg-topics.adoc#enable-iceberg-integration[Iceberg mode] you've chosen for a topic, and whether you've registered a schema for the topic in the xref:manage:schema-reg/schema-reg-overview.adoc[Redpanda Schema Registry]. In either mode, you do not need to rely on complex ETL jobs or pipelines to access real-time data from Redpanda. |
There was a problem hiding this comment.
@kbatuigas "In any mode" not "in either mode" (since we now have 3 modes)
There was a problem hiding this comment.
Will be updating in a separate PR for 25.1
|
|
||
| When you access Iceberg topics from a data lakehouse or other Iceberg-compatible tools, how you consume the data depends on the xref:manage:iceberg/about-iceberg-topics.adoc#enable-iceberg-integration[Iceberg mode] you've chosen for a topic, and whether you've registered a schema for the topic in the xref:manage:schema-reg/schema-reg-overview.adoc[Redpanda Schema Registry]. In either mode, you do not need to rely on complex ETL jobs or pipelines to access real-time data from Redpanda. | ||
|
|
||
| include::25.1@ROOT:manage:partial$iceberg/query-iceberg-topics.adoc[] No newline at end of file |
There was a problem hiding this comment.
does this need 25.1 in the directive? Same for all. We should remove if not necessary.
There was a problem hiding this comment.
Removing the version number caused build errors. I'll keep them here for now.
| :env-byoc: true | ||
|
|
||
| include::25.1@ROOT:manage:partial$iceberg/use-iceberg-catalogs.adoc[] | ||
|
|
There was a problem hiding this comment.
@kbatuigas I need to pull in the new 25.1 properties, then they'll get single sourced into cloud. So we might need to go back to update these links later.
There was a problem hiding this comment.
Discussed in team meeting
Description
This pull request introduces multiple changes to integrate and document the Iceberg feature in Redpanda. The most important changes include updating the branches to track in the playbook, adding new navigation links for Iceberg documentation, and creating new documentation pages for Iceberg-related features.
This PR adds AsciiDoc pages that contain
env-byocpage attributes that will cause Cloud-specific content to appear. (See redpanda-data/docs#1032 for how conditional directives delineate which content is specific to Cloud.)Iceberg Integration Documentation:
modules/ROOT/nav.adoc: Added navigation links for Iceberg documentation, including sections on about Iceberg topics, using Iceberg catalogs, and querying Iceberg topics.modules/get-started/pages/whats-new-cloud.adoc: Added a new entry for April 2025 announcing the beta release of Iceberg topics, detailing its benefits and supported platforms.New Iceberg Documentation Pages:
modules/manage/pages/iceberg/about-iceberg-topics.adoc: Created a new page to explain how Redpanda can integrate topics with Apache Iceberg.modules/manage/pages/iceberg/index.adoc: Added an index page for Iceberg documentation, describing how to generate Iceberg tables for Redpanda topics.modules/manage/pages/iceberg/query-iceberg-topics.adoc: Created a new page detailing how to query Redpanda topic data stored in Iceberg tables.modules/manage/pages/iceberg/use-iceberg-catalogs.adoc: Added a page explaining how to access Redpanda topic data stored in Iceberg tables using table metadata or catalog integration.Playbook Update:
local-antora-playbook.yml: Updated the branches to track in the Redpanda documentation repository, including the new '805-single-source-iceberg' branch.API Documentation Update:
modules/manage/partials/controlplane-api.adoc: Added a new section on updating cluster configuration properties, including enabling Iceberg and setting the Iceberg catalog type.Resolves https://github.com/redpanda-data/documentation-private/issues/
Review deadline: 3 Apr
Page previews
What's New in Cloud
Manage > Iceberg (beta)
Manage > Cloud API > Use the Control Plane API with BYOC
Checks