You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**Note**: This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
9
+
This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
You can optionally add additional providers. The application supports the following providers
122
-
123
-
- Hugging Face Text Generation Inference Server
124
-
- OpenAI
125
-
- NVIDIA
126
-
127
-
Click on the `Add Provider` tab to add a new provider. Fill in the details and click `Add Provider` button. The provider should be added in the `Providers` dropdown under `Chatbot` tab.
### Generate the proposal document using OpenAI provider
132
-
133
-
Follow the instructions in step 3 to generate the proposal document using the OpenAI provider.
134
-
135
-

136
-
137
-
### Rating the provider
138
-
139
-
You can provide rating to the model by clicking on the `Rate the model` radio button. The rating will be captured as part of the metrics and can help the company which model to deploy in production.
140
-
141
-
### Grafana Dashboard
142
-
143
-
By default, Grafana application is deployed in `llm-monitoring` namespace. Launch the Grafana Dashboard, by running the following instructions:
144
-
145
-
- Grab the credentials of Grafana Application
146
-
- Navigate to Workloads --> Secrets
147
-
- Click on the grafana-admin-credentials and copy the GF_SECURITY_ADMIN_USER, GF_SECURITY_ADMIN_PASSWORD
148
-
- Launch Grafana Dashboard
149
-
- Click the `Application box` icon in the header, and select `Grafana UI for LLM ratings`
**Note**: This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
162
-
163
-
```yaml
164
-
---
165
-
global:
166
-
pattern: rag-llm-gitops
167
-
options:
168
-
useCSV: false
169
-
syncPolicy: Automatic
170
-
installPlanApproval: Automatic
171
-
# Possible value for db.type = [REDIS, EDB]
172
-
db:
173
-
index: docs
174
-
type: EDB # <--- Default is EDB, Change the db type to REDIS for Redis deployment
You can provide rating to the model by clicking on the `Rate the model` radio button. The rating will be captured as part of the metrics and can help the company which model to deploy in production.
9
+
You can provide rating to the model by clicking on the `Rate the model` radio button. The rating are captured as part of the metrics and can help the company decide which model to deploy in production.
10
10
11
11
## Grafana Dashboard
12
12
13
-
By default, Grafana application is deployed in `llm-monitoring` namespace. Launch the Grafana Dashboard, by running the following instructions:
14
-
15
-
- Grab the credentials of Grafana Application
16
-
- Navigate to Workloads --> Secrets
17
-
- Click on the grafana-admin-credentials and copy the GF_SECURITY_ADMIN_USER, GF_SECURITY_ADMIN_PASSWORD
18
-
- Launch Grafana Dashboard
19
-
- Click the `Application box` icon in the header, and select `Grafana UI for LLM ratings`
By default, the Grafana application is deployed in the `llm-monitoring` namespace. You can track the ratings by logging in to the Grafana Dashboard by following the steps below.
25
14
15
+
1. In the OpenShift web console go to **Workloads** > **Secrets**.
26
16
17
+
2. Click on the `ai-llm-grafana-admin-credentials` scroll down.
27
18
19
+
3. Launch Grafana Dashboard by clicking the `Application box` icon in the header, and select `Grafana UI for LLM ratings`.
28
20
29
-
### Deploy application
30
-
31
-
**Note**: This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
type: EDB # <--- Default is EDB, Change the db type to REDIS for Redis deployment
45
-
main:
46
-
clusterGroupName: hub
47
-
multiSourceConfig:
48
-
enabled: true
49
-
```
24
+
5. Enter the Grafana admin credentials. Copy the `GF_SECURITY_ADMIN_USER`, `GF_SECURITY_ADMIN_PASSWORD` from `ai-llm-grafana-admin-credentials` screen in the OpenShift web console.
0 commit comments