Skip to content

Commit 9165f9c

Browse files
fhennigrazvan
andauthored
docs: pod overrides (#517)
* docs: pod overrides * various small docs fixes * Update docs/modules/hive/pages/getting_started/first_steps.adoc * Update docs/modules/hive/pages/index.adoc * Update docs/modules/hive/pages/reference/commandline-parameters.adoc * Update docs/modules/hive/pages/usage-guide/operations/graceful-shutdown.adoc * Update docs/modules/hive/pages/usage-guide/operations/pod-disruptions.adoc --------- Co-authored-by: Razvan-Daniel Mihai <[email protected]>
1 parent 18791e6 commit 9165f9c

File tree

14 files changed

+46
-35
lines changed

14 files changed

+46
-35
lines changed

docs/modules/hive/pages/getting_started/first_steps.adoc

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
= First steps
2-
:description: Deploy and verify a Hive metastore cluster with PostgreSQL and MinIO. Follow our setup guide and ensure all pods are ready for operation.
2+
:description: Deploy and verify a Hive metastore cluster with PostgreSQL and MinIO. Follow the setup guide and ensure all pods are ready for operation.
33

4-
After going through the xref:getting_started/installation.adoc[] section and having installed all the operators, you will now deploy a Hive metastore cluster and it's dependencies.
5-
Afterwards you can <<_verify_that_it_works, verify that it works>>.
4+
After going through the xref:getting_started/installation.adoc[] section and having installed all the operators, deploy a Hive metastore cluster and it's dependencies.
5+
Afterward you can <<_verify_that_it_works, verify that it works>>.
66

77
== Setup
88

docs/modules/hive/pages/getting_started/index.adoc

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
= Getting started
22
:description: Learn to set up Apache Hive with the Stackable Operator. Includes installation, dependencies, and creating a Hive metastore on Kubernetes.
33

4-
This guide will get you started with Apache Hive using the Stackable Operator.
5-
It will guide you through the installation of the operator, its dependencies and setting up your first Hive metastore instance.
4+
This guide gets you started with Apache Hive using the Stackable Operator.
5+
It guides you through the installation of the operator, its dependencies and setting up your first Hive metastore instance.
66

77
== Prerequisites
88

9-
You will need:
9+
You need:
1010

1111
* a Kubernetes cluster
1212
* kubectl

docs/modules/hive/pages/getting_started/installation.adoc

Lines changed: 6 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
= Installation
2-
:description: Install Stackable Operator for Apache Hive with MinIO and PostgreSQL using stackablectl or Helm. Follow our guide for easy setup and configuration.
2+
:description: Install Stackable Operator for Apache Hive with MinIO and PostgreSQL using stackablectl or Helm. Follow the guide for easy setup and configuration.
33

4-
On this page you will install the Stackable Operator for Apache Hive and all required dependencies.
4+
On this page you install the Stackable operator for Apache Hive and all required dependencies.
55
For the installation of the dependencies and operators you can use Helm or `stackablectl`.
66

77
The `stackablectl` command line tool is the recommended way to interact with operators and dependencies.
@@ -10,7 +10,7 @@ Follow the xref:management:stackablectl:installation.adoc[installation steps] fo
1010
== Dependencies
1111

1212
First you need to install MinIO and PostgreSQL instances for the Hive metastore.
13-
PostgreSQL is required as a database for Hive's metadata, and MinIO will be used as a data store, which the Hive metastore also needs access to.
13+
PostgreSQL is required as a database for Hive's metadata, and MinIO is used as a data store, which the Hive metastore also needs access to.
1414

1515
There are two ways to install the dependencies:
1616

@@ -66,7 +66,7 @@ Now call `stackablectl` and reference those two files:
6666
include::example$getting_started/getting_started.sh[tag=stackablectl-install-minio-postgres-stack]
6767
----
6868

69-
This will install MinIO and PostgreSQL as defined in the Stacks, as well as the Operators.
69+
This installs MinIO and PostgreSQL as defined in the Stacks, as well as the operators.
7070
You can now skip the <<Stackable Operators>> step that follows next.
7171

7272
TIP: Consult the xref:management:stackablectl:quickstart.adoc[Quickstart] to learn more about how to use `stackablectl`.
@@ -107,7 +107,7 @@ Run the following command to install all operators necessary for Apache Hive:
107107
include::example$getting_started/getting_started.sh[tag=stackablectl-install-operators]
108108
----
109109

110-
The tool will show
110+
The tool prints
111111

112112
[source]
113113
----
@@ -132,8 +132,7 @@ Then install the Stackable operators:
132132
include::example$getting_started/getting_started.sh[tag=helm-install-operators]
133133
----
134134

135-
Helm will deploy the operators in a Kubernetes Deployment and apply the CRDs for the Apache Hive service (as well as the CRDs for the required operators).
136-
You are now ready to deploy the Apache Hive metastore in Kubernetes.
135+
Helm deploys the operators in a Kubernetes Deployment and apply the CRDs for the Apache Hive service (as well as the CRDs for the required operators).
137136

138137
== What's next
139138

docs/modules/hive/pages/index.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ This operator does not support deploying Hive itself, but xref:trino:index.adoc[
1919

2020
== Getting started
2121

22-
Follow the xref:getting_started/index.adoc[Getting started guide] which will guide you through installing the Stackable Hive operator and its dependencies.
22+
Follow the xref:getting_started/index.adoc[Getting started guide] which guides you through the installation of the Stackable Hive operator and its dependencies.
2323
It walks you through setting up a Hive metastore and connecting it to a demo Postgres database and a Minio instance to store data in.
2424

2525
Afterwards you can consult the xref:usage-guide/index.adoc[] to learn more about tailoring your Hive metastore configuration to your needs, or have a look at the <<demos, demos>> for some example setups with either xref:trino:index.adoc[Trino] or xref:spark-k8s:index.adoc[Spark].

docs/modules/hive/pages/reference/commandline-parameters.adoc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -23,8 +23,8 @@ stackable-hive-operator run --product-config /foo/bar/properties.yaml
2323

2424
*Multiple values:* false
2525

26-
If provided the operator will **only** watch for resources in the provided namespace.
27-
If not provided it will watch in **all** namespaces.
26+
If provided, the operator **only** watches for resources in the provided namespace.
27+
If not provided, it watches in **all** namespaces.
2828

2929
.Example: Only watch the `test` namespace
3030
[source,bash]

docs/modules/hive/pages/reference/environment-variables.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -36,7 +36,7 @@ docker run \
3636

3737
*Multiple values:* false
3838

39-
The operator will **only** watch for resources in the provided namespace `test`:
39+
The operator **only** watches for resources in the provided namespace `test`:
4040

4141
[source]
4242
----

docs/modules/hive/pages/usage-guide/configuration-environment-overrides.adoc

Lines changed: 15 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -40,15 +40,19 @@ metastore:
4040
replicas: 1
4141
----
4242

43-
All override property values must be strings. The properties will be formatted and escaped correctly into the XML file.
43+
All override property values must be strings.
44+
The properties are formatted and escaped correctly into the XML file.
4445

4546
For a full list of configuration options we refer to the Hive https://cwiki.apache.org/confluence/display/hive/configuration+properties[Configuration Reference].
4647

4748
== The security.properties file
4849

49-
The `security.properties` file is used to configure JVM security properties. It is very seldom that users need to tweak any of these, but there is one use-case that stands out, and that users need to be aware of: the JVM DNS cache.
50+
The `security.properties` file is used to configure JVM security properties.
51+
It is very seldom that users need to tweak any of these, but there is one use-case that stands out, and that users need to be aware of: the JVM DNS cache.
5052

51-
The JVM manages its own cache of successfully resolved host names as well as a cache of host names that cannot be resolved. Some products of the Stackable platform are very sensible to the contents of these caches and their performance is heavily affected by them. As of version 3.1.3 Apache Hive performs poorly if the positive cache is disabled. To cache resolved host names, you can configure the TTL of entries in the positive cache like this:
53+
The JVM manages its own cache of successfully resolved host names as well as a cache of host names that cannot be resolved. Some products of the Stackable platform are very sensible to the contents of these caches and their performance is heavily affected by them.
54+
As of version 3.1.3 Apache Hive performs poorly if the positive cache is disabled.
55+
To cache resolved host names, you can configure the TTL of entries in the positive cache like this:
5256

5357
[source,yaml]
5458
----
@@ -64,9 +68,10 @@ NOTE: The operator configures DNS caching by default as shown in the example abo
6468
For details on the JVM security see https://docs.oracle.com/en/java/javase/11/security/java-security-overview1.html
6569

6670

67-
== Environment Variables
71+
== Environment variables
6872

69-
In a similar fashion, environment variables can be (over)written. For example per role group:
73+
In a similar fashion, environment variables can be (over)written.
74+
For example per role group:
7075

7176
[source,yaml]
7277
----
@@ -91,3 +96,8 @@ metastore:
9196
config: {}
9297
replicas: 1
9398
----
99+
100+
== Pod overrides
101+
102+
The Hive operator also supports Pod overrides, allowing you to override any property that you can set on a Kubernetes Pod.
103+
Read the xref:concepts:overrides.adoc#pod-overrides[Pod overrides documentation] to learn more about this feature.

docs/modules/hive/pages/usage-guide/database-driver.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -88,7 +88,7 @@ spec:
8888
mountPath: /stackable/externals
8989
----
9090

91-
This will make the driver available at `/stackable/external-drivers/mysql-connector-j-8.0.31.jar` when the volume `external-drivers` is mounted at `/stackable/external-drivers`.
91+
This makes the driver available at `/stackable/external-drivers/mysql-connector-j-8.0.31.jar` when the volume `external-drivers` is mounted at `/stackable/external-drivers`.
9292

9393
Once the above has completed successfully, you can confirm that the driver is in the expected location by running another job:
9494

docs/modules/hive/pages/usage-guide/derby-example.adoc

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
= Derby example
22
:description: Deploy a single-node Apache Hive Metastore with Derby or PostgreSQL. Includes setup for S3 integration and tips for database configuration.
33

4-
Please note that the version you need to specify is not only the version of Apache Hive which you want to roll out, but has to be amended with a Stackable version as shown.
4+
The version you need to specify is not only the version of Apache Hive which you want to roll out, but has to be amended with a Stackable version as shown.
55
This Stackable version is the version of the underlying container image which is used to execute the processes.
6-
For a list of available versions please check our https://repo.stackable.tech/#browse/browse:docker:v2%2Fstackable%2Fhive%2Ftags[image registry].
6+
For a list of available versions check the https://repo.stackable.tech/#browse/browse:docker:v2%2Fstackable%2Fhive%2Ftags[image registry].
77
It should generally be safe to simply use the latest image version that is available.
88

99
.Create a single node Apache Hive Metastore cluster using Derby:
@@ -123,7 +123,7 @@ This is called `scram-sha-256` and has been the default as of PostgreSQL 14.
123123
Unfortunately, Hive up until the latest 3.3.x version ships with JDBC drivers that do https://wiki.postgresql.org/wiki/List_of_drivers[_not_ support] this method.
124124
You might see an error message like this:
125125
`The authentication type 10 is not supported.`
126-
If this is the case please either use an older PostgreSQL version or change its https://www.postgresql.org/docs/current/runtime-config-connection.html#GUC-PASSWORD-ENCRYPTION[`password_encryption`] setting to `md5`.
126+
If this is the case, either use an older PostgreSQL version or change its https://www.postgresql.org/docs/current/runtime-config-connection.html#GUC-PASSWORD-ENCRYPTION[`password_encryption`] setting to `md5`.
127127
128128
This installs PostgreSQL in version 10 to work around the issue mentioned above:
129129
[source,bash]
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
= Usage guide
22
:page-aliases: usage.adoc
33

4-
This Section will help you to use and configure the Stackable Operator for Apache Hive in various ways.
4+
This Section helps you to use and configure the Stackable operator for Apache Hive in various ways.
55
You should already be familiar with how to set up a basic instance.
66
Follow the xref:getting_started/index.adoc[] guide to learn how to set up a basic instance with all the required dependencies.

0 commit comments

Comments
 (0)