Skip to content

Commit c1f8b1d

Browse files
jpiperkimoonkim
authored andcommitted
Remove resolv.conf and associated docs (#20)
* Remove resolv.conf As it’s no longer needed due to #16 Fixes #19 * Update docs to reflect k8s 1.6 requirement
1 parent e73a6a7 commit c1f8b1d

File tree

8 files changed

+10
-135
lines changed

8 files changed

+10
-135
lines changed

charts/README.md

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,13 @@
1+
### Prerequisite
2+
3+
Requires Kubernetes 1.6 as the `namenode` and `datanodes` are using `ClusterFirstWithHostNet`, which was introduced in Kubernetes 1.6
4+
5+
### Usage
6+
17
Helm charts for launching HDFS in a K8s cluster. They should be launched in
28
the following order.
39

4-
1. `hdfs-resolv-conf`: Creates a config map containing resolv.conf used by
5-
the HDFS daemons. See `hdfs-resolv-conf/README.md` for how to launch.
6-
2. `hdfs-namenode-k8s`: Launches the hdfs namenode. See
10+
1. `hdfs-namenode-k8s`: Launches the hdfs namenode. See
711
`hdfs-namenode-k8s/README.md` for how to launch.
8-
3. `hdfs-datanode-k8s`: Launches the hdfs datanode daemons. See
12+
2. `hdfs-datanode-k8s`: Launches the hdfs datanode daemons. See
913
`hdfs-datanode-k8s/README.md` for how to launch.

charts/hdfs-datanode-k8s/README.md

Lines changed: 0 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,6 @@
11
HDFS `datanodes` running inside a kubernetes cluster. See the other chart for
22
`namenode`.
33

4-
### Prerequisite
5-
6-
Requires Kubernetes version 1.5 and beyond, because `namenode` is using
7-
`StatefulSet`, which is available only in version 1.5 and later.
8-
9-
Make sure the `hdfs-resolv-conf` chart is launched. Also ensure `namenode` is
10-
fully launched using the corresponding chart. `Datanodes` rely
11-
on DNS to resolve the hostname of the namenode when they start up.
12-
134
### Usage
145

156
1. In some setup, the master node may launch a datanode. To prevent this,

charts/hdfs-datanode-k8s/templates/datanode-daemonset.yaml

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,8 @@ spec:
3232
- name: datanode
3333
image: uhopper/hadoop-datanode:2.7.2
3434
env:
35+
- name: CORE_CONF_fs_defaultFS
36+
value: hdfs://hdfs-namenode-0.hdfs-namenode.default.svc.cluster.local:8020
3537
# The below uses two loops to make sure the last item does not have comma. It uses index 0
3638
# for the last item since that is the only special index that helm template gives us.
3739
- name: HDFS_CONF_dfs_datanode_data_dir
@@ -46,10 +48,6 @@ spec:
4648
/hadoop/dfs/data/{{ $index }}
4749
{{- end }}
4850
{{- end }}
49-
# This works only with /etc/resolv.conf mounted from the config map.
50-
# K8s version 1.6 will fix this, per https://github.com/kubernetes/kubernetes/pull/29378.
51-
- name: CORE_CONF_fs_defaultFS
52-
value: hdfs://hdfs-namenode-0.hdfs-namenode.default.svc.cluster.local:8020
5351
# We now add custom hadoop configuration provided
5452
{{- range $key, $value := .Values.customHadoopConfig }}
5553
{{- if and (ne $key "HDFS_CONF_dfs_datanode_data_dir") (ne $key "CORE_CONF_fs_defaultFS") }}

charts/hdfs-namenode-k8s/README.md

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,6 @@
11
HDFS `namenode` running inside a kubernetes cluster. See the other chart for
22
`datanodes`.
33

4-
### Prerequisite
5-
6-
Requires Kubernetes version 1.5 and beyond, because `namenode` is using
7-
`StatefulSet`, which is available only in version 1.5 and later.
8-
9-
Make sure the `hdfs-resolv-conf` chart is launched.
10-
114
### Usage
125

136
1. Attach a label to one of your k8s cluster host that will run the `namenode`

charts/hdfs-resolv-conf/Chart.yaml

Lines changed: 0 additions & 17 deletions
This file was deleted.

charts/hdfs-resolv-conf/README.md

Lines changed: 0 additions & 40 deletions
This file was deleted.

charts/hdfs-resolv-conf/templates/resolve-conf-configmap.yaml

Lines changed: 0 additions & 27 deletions
This file was deleted.

charts/hdfs-resolv-conf/values.yaml

Lines changed: 0 additions & 27 deletions
This file was deleted.

0 commit comments

Comments
 (0)