using confluent CLI with CFK

Author: sionsmith

examples/confluent-cli/README.md

@@ -0,0 +1,44 @@
+# Using Confluent CLI with CFK
+This example deploys a basic deployment.  No RBAC/LDAP.  Just a single topic 'foobar' is added as part of the pipeline.
+
+### Deploy CRDs
+Deploy the CRDS using the standard way:
+```shell
+cd examples/confluent-cli
+kubectl apply -k ../../kustomize/crds
+```
+
+### Deploy Confluent Operator and Confluent Services
+Deploy the confluent operator and services:
+```shell
+kubectl apply -k .
+```
+
+### Using the proxy without MDS
+You need to run the following commands:
+```shell
+$ kubectl port-forward -n tools proxy 9100:9100
+
+export HTTPS_PROXY=socks5://127.0.0.1:9100
+
+KAFKA_ID=$(curl -x socks5h://127.0.0.1:9100 -ks https://kafka.sandbox.svc.cluster.local:8090/v1/metadata/id | jq -r '.scope.clusters["kafka-cluster"]')
+
+CONFLUENT_USERNAME=kafka \
+CONFLUENT_PASSWORD=kafka-secret \
+confluent login
+
+```
+
+### Using the proxy with MDS / RBAC
+You will need to run some extra commands:
+```shell
+export HTTPS_PROXY=socks5://127.0.0.1:9100
+
+KAFKA_ID=$(curl -x socks5h://127.0.0.1:9100 -ks https://kafka.sandbox.svc.cluster.local:8090/v1/metadata/id | jq -r '.scope.clusters["kafka-cluster"]')
+
+CONFLUENT_USERNAME=kafka \
+CONFLUENT_PASSWORD=kafka-secret \
+CONFLUENT_MDS_URL=https://kafka.sandbox.svc.cluster.local:8090 \
+CONFLUENT_CA_CERT_PATH=../certificates/rootca.pem \ #pull from tls-group1 secret 
+confluent login
+```

examples/confluent-cli/confluent/control-centre.yaml

@@ -0,0 +1,27 @@
+---
+apiVersion: platform.confluent.io/v1beta1
+kind: ControlCenter
+metadata:
+  name: controlcenter
+spec:
+  tls:
+    autoGeneratedCerts: true
+  dependencies:
+    kafka:
+      bootstrapEndpoint: kafka.sandbox.svc.cluster.local:9071
+      tls:
+        enabled: true
+    connect:
+      - name: connect
+        url:  https://connect.sandbox.svc.cluster.local:8083
+        tls:
+          enabled: true
+    ksqldb:
+      - name: ksqldb
+        url:  https://ksqldb.sandbox.svc.cluster.local:8088
+        tls:
+          enabled: true
+    schemaRegistry:
+      url: https://schemaregistry.sandbox.svc.cluster.local:8081
+      tls:
+        enabled: true

examples/confluent-cli/confluent/kafka-connect.yaml

@@ -0,0 +1,14 @@
+---
+apiVersion: platform.confluent.io/v1beta1
+kind: Connect
+metadata:
+  name: connect
+spec:
+  tls:
+    autoGeneratedCerts: true
+  dependencies:
+    kafka:
+      bootstrapEndpoint: kafka.sandbox.svc.cluster.local:9071
+      tls:
+        enabled: true
+

examples/confluent-cli/confluent/kafka.yaml

@@ -0,0 +1,22 @@
+apiVersion: platform.confluent.io/v1beta1
+kind: Kafka
+metadata:
+  name: kafka
+spec:
+  configOverrides:
+    server:
+      - confluent.schema.registry.url=https://schemaregistry.sandbox.svc.cluster.local:8081
+  tls:
+    autoGeneratedCerts: true
+  listeners:
+    internal:
+      tls:
+        enabled: true
+    external:
+      tls:
+        enabled: true
+  dependencies:
+    zookeeper:
+      endpoint: zookeeper.sandbox.svc.cluster.local:2182
+      tls:
+        enabled: true

examples/confluent-cli/confluent/ksqldb.yaml

@@ -0,0 +1,13 @@
+---
+apiVersion: platform.confluent.io/v1beta1
+kind: KsqlDB
+metadata:
+  name: ksqldb
+spec:
+  tls:
+    autoGeneratedCerts: true
+  dependencies:
+    kafka:
+      bootstrapEndpoint: kafka.sandbox.svc.cluster.local:9071
+      tls:
+        enabled: true

examples/confluent-cli/confluent/kustomization.yaml

@@ -0,0 +1,12 @@
+namespace: sandbox
+resources:
+- namespace.yaml
+- ../../../kustomize/base/confluent
+- ../../../kustomize/base/secrets-tls
+patchesStrategicMerge:
+  - zookeeper.yaml
+  - kafka.yaml
+  - control-centre.yaml
+  - kafka-connect.yaml
+  - ksqldb.yaml
+  - schema-registry.yaml

examples/confluent-cli/confluent/namespace.yaml

@@ -0,0 +1,4 @@
+apiVersion: v1
+kind: Namespace
+metadata:
+  name: sandbox

examples/confluent-cli/confluent/schema-registry.yaml

@@ -0,0 +1,12 @@
+apiVersion: platform.confluent.io/v1beta1
+kind: SchemaRegistry
+metadata:
+  name: schemaregistry
+spec:
+  tls:
+    autoGeneratedCerts: true
+  dependencies:
+    kafka:
+      bootstrapEndpoint: kafka.sandbox.svc.cluster.local:9071
+      tls:
+        enabled: true

examples/confluent-cli/confluent/zookeeper.yaml

@@ -0,0 +1,7 @@
+apiVersion: platform.confluent.io/v1beta1
+kind: Zookeeper
+metadata:
+  name: zookeeper
+spec:
+  tls:
+    autoGeneratedCerts: true

examples/confluent-cli/kustomization.yaml

@@ -0,0 +1,6 @@
+namespace: sandbox
+resources:
+  - confluent
+  - operator
+  - topics
+  - proxy.yaml