Merge branch 'main' into dependabot/npm_and_yarn/OJET-(VDOM)---OCI-Vision/jet_virtual_dom_app/multi-7974adb1ac

Author: jasperan

OJET (VDOM) - OCI Vision/jet_virtual_dom_app/package-lock.json

@@ -7,6 +7,7 @@ __pycache__/
 venv/
 env/
 .env
+kubeconfig
 
 # IDE
 .vscode/
@@ -19,6 +20,27 @@ env/
 embeddings/
 chroma_db/
 docs/*.json
+**/.certs
+**/node_modules
+k8s/kustom/demo/config.yaml
+k8s/kustom/demo/wallet/
+**/generated/
+
+# Terraform
+**/.terraform/*
+*.plan
+*.tfstate
+*.tfstate.*
+crash.log
+crash.*.log
+*.tfvars
+*.tfvars.json
+override.tf
+override.tf.json
+*_override.tf
+*_override.tf.json
+.terraformrc
+terraform.rc
 
 # Distribution / packaging
 dist/

agentic_rag/.gitignore

@@ -0,0 +1,120 @@
+# Deploy with Terraform and Kustomize
+
+## TODOS
+
+- Multiple containers for different functions
+  - Gradio
+  - Agents / Inference
+  - Database Access
+- Hugging face token should be a secret
+- Liveness and Readiness
+- Use Load balancer instead of Gradio Live
+- Autoscaling
+
+## Deploy Infrastructure
+
+Install scripts dependencies
+
+```bash
+cd scripts/ && npm install && cd ..
+```
+
+Set environment (answer questions) and generate Terraform `tfvars` file.
+
+```bash
+zx scripts/setenv.mjs
+```
+
+> Alternative: One liner for the yellow commands (for easy copy paste)
+>
+> ```bash
+> cd tf && terraform init && terraform apply -auto-approve
+> ```
+
+Come back to root folder
+
+```bash
+cd ..
+```
+
+Prepare Kubeconfig and namespace:
+
+```bash
+zx scripts/kustom.mjs
+```
+
+## Deploy Application
+
+Export kubeconfig to get access to the Kubernetes Cluster
+
+```bash
+export KUBECONFIG="$(pwd)/tf/generated/kubeconfig"
+```
+
+Check everything works
+
+```bash
+kubectl cluster-info
+```
+
+Deploy the production overlay
+
+```bash
+kubectl apply -k k8s/kustom/overlays/prod
+```
+
+Check all pods are Ready:
+
+```bash
+kubectl get po --namespace=agentic-rag
+```
+
+Get Gradio Live URL:
+
+```bash
+kubectl logs $(kubectl get po -n agentic-rag -l app=agentic-rag -o name) -n agentic-rag | grep "Running on public URL"
+```
+
+Open the URL from the command before in your browser.
+
+Also, you could get the Load Balancer Public IP address:
+
+```bash
+echo "http://$(kubectl get service \
+  -n agentic-rag \
+  -o jsonpath='{.items[?(@.spec.type=="LoadBalancer")].status.loadBalancer.ingress[0].ip}')"
+```
+
+To troubleshoot connect to the container
+
+```bash
+kubectl exec -it $(kubectl get po -n agentic-rag -l app=agentic-rag -o name) -n agentic-rag -- sh
+```
+
+## Clean up
+
+Delete the production overlay
+
+```bash
+kubectl delete -k k8s/kustom/overlays/prod
+```
+
+Destroy infrastructure with Terraform.
+
+```bash
+cd tf
+```
+
+```bash
+terraform destroy -auto-approve
+```
+
+```bash
+cd ..
+```
+
+Clean up the artifacts and config files
+
+```bash
+zx scripts/clean.mjs
+```