test: Add test for Apache Iceberg integration #785
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
sbernauer
commented
Apr 29, 2025
Member
Author
sbernauer
moved this from Development: In Progress
to Development: Waiting for Review
in Stackable Engineering
NickLarsenNZ
moved this from Development: Waiting for Review
to Development: In Review
in Stackable Engineering
3 tasks
Member
Author
docs/modules/nifi/pages/usage_guide/writing-to-iceberg-tables.adoc
Outdated
Show resolved
Hide resolved
…adoc Co-authored-by: Nick <[email protected]>
Member
Author
|
Tests passed 🚀 |
sbernauer
moved this from Development: In Review
to Development: Done
in Stackable Engineering
labrenbe
pushed a commit
that referenced
this pull request
May 21, 2025
* Clean up smoke test * clean up smoke test part 2 * Add working test :) * Move files * Add and test HDFS functionality * Kerbize HDFS and HMS * Add Kerberos test * Use nightly image * linter * Update Iceberg docs * changelog * Small bumps * Update docs/modules/nifi/pages/usage_guide/writing-to-iceberg-tables.adoc Co-authored-by: Nick <[email protected]> --------- Co-authored-by: Nick <[email protected]>
github-merge-queue bot
pushed a commit
that referenced
this pull request
Jul 4, 2025
* add support for listeners * add very basic integration test * add pr number to changelog * add external-access test * chore: Add NiFi 2.4.0 and remove 2.2.0 (#797) add NiFi 2.4.0 and remove 2.2.0 * test: Add test for Apache Iceberg integration (#785) * Clean up smoke test * clean up smoke test part 2 * Add working test :) * Move files * Add and test HDFS functionality * Kerbize HDFS and HMS * Add Kerberos test * Use nightly image * linter * Update Iceberg docs * changelog * Small bumps * Update docs/modules/nifi/pages/usage_guide/writing-to-iceberg-tables.adoc Co-authored-by: Nick <[email protected]> --------- Co-authored-by: Nick <[email protected]> * wip: update listener implementation based on implementation for superset operator * use single listener with pvc per rolegroup * update integration tests with crd change * restore iceberg test file * fix listener class in iceberg test * expose https port in headless service * update comment * address feedback from review * remove unused error variants * create headless service name in function * remove unused functions * move listenerClass to roleConfig * use new headless service name in integration tests * move listener constants to listener module * remove duplicate iceberg test * remove hard-coded names * fix integration tests * remove hardcoded role name * improve code quality * set rolegroup label on listener pvcs to none * fix app version label on listener * set rolegroup label on listener pvcs * remove listener class from trino in iceberg test * add note on custom ListenerClasses to docs * remove version argument in reporting task * rename headless service * fix iceberg test * create separate headless services * add missing file * fix iceberg test * use listener scope for tls --------- Co-authored-by: Sebastian Bernauer <[email protected]> Co-authored-by: Nick <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Part of #738
Needs stackabletech/docker-images#1060
Definition of Done Checklist
Author
Reviewer
Acceptance