Skip to content

Conversation

@siegfriedweber
Copy link
Member

@siegfriedweber siegfriedweber commented Sep 30, 2024

Description

Fix the build of the Spark HBase connector on aarch64.

For aarch64, the protoc artifact from com.github.os72 is used. The same was already done for Hive (https://github.com/stackabletech/docker-images/blob/24.7.0/hive/stackable/patches/3.1.3/002-HIVE-21939-3.1.3.patch).

The "Apache Hadoop YARN Application Catalog Webapp" required an update of the node version to 14.17.0.

The Hadoop version was changed from 3.3.4 to 3.3.6 because this version is used for the HBase image. This reduces the build time and the required disk space.

part of #870

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes
- [x] Changes are OpenShift compatible
- [x] All added packages (via microdnf or otherwise) have a comment on why they are added
- [x] Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
- [x] All packages should have (if available) signatures/hashes verified
- [x] Add an entry to the CHANGELOG.md file
- [x] Integration tests ran successfully
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

bake --product <product> --image-version <stackable-image-version>
kind load docker-image <image-tagged-with-the-major-version> --name=<name-of-your-test-cluster>

See the output of bake to retrieve the image tag for <image-tagged-with-the-major-version>.

@siegfriedweber siegfriedweber self-assigned this Sep 30, 2024
@siegfriedweber siegfriedweber force-pushed the fix/spark-hbase-connector-on-aarch64 branch from 5e8f6d9 to 90dc340 Compare October 1, 2024 09:01
@siegfriedweber
Copy link
Member Author

siegfriedweber commented Oct 1, 2024

@siegfriedweber siegfriedweber marked this pull request as ready for review October 1, 2024 11:31
@siegfriedweber siegfriedweber requested a review from razvan October 1, 2024 11:31
@siegfriedweber siegfriedweber requested a review from a team October 2, 2024 06:20
sbernauer
sbernauer previously approved these changes Oct 2, 2024
Copy link
Member

@sbernauer sbernauer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Co-authored-by: Sebastian Bernauer <[email protected]>
Co-authored-by: Sebastian Bernauer <[email protected]>
@siegfriedweber siegfriedweber added this pull request to the merge queue Oct 2, 2024
Merged via the queue into main with commit 47b9d06 Oct 2, 2024
2 checks passed
@siegfriedweber siegfriedweber deleted the fix/spark-hbase-connector-on-aarch64 branch October 2, 2024 07:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants