Skip to content

Commit 3a04d89

Browse files
committed
reformatting section 3
1 parent efff8b3 commit 3a04d89

File tree

6 files changed

+11
-165
lines changed

6 files changed

+11
-165
lines changed

content/patterns/rag-llm-gitops/deploying-different-db.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ aliases: /rag-llm-gitops/getting-started/
66

77
# Deploying a different database
88

9-
**Note**: This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
9+
This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
1010

1111
```yaml
1212
---

content/patterns/rag-llm-gitops/getting-started.md

Lines changed: 0 additions & 62 deletions
Original file line numberDiff line numberDiff line change
@@ -116,66 +116,4 @@ aliases: /rag-llm-gitops/getting-started/
116116

117117
![Routes](/images/rag-llm-gitops/proposal.png)
118118

119-
### Add an OpenAI provider
120-
121-
You can optionally add additional providers. The application supports the following providers
122-
123-
- Hugging Face Text Generation Inference Server
124-
- OpenAI
125-
- NVIDIA
126-
127-
Click on the `Add Provider` tab to add a new provider. Fill in the details and click `Add Provider` button. The provider should be added in the `Providers` dropdown under `Chatbot` tab.
128-
129-
![Routes](/images/rag-llm-gitops/add_provider.png)
130-
131-
### Generate the proposal document using OpenAI provider
132-
133-
Follow the instructions in step 3 to generate the proposal document using the OpenAI provider.
134-
135-
![Routes](/images/rag-llm-gitops/chatgpt.png)
136-
137-
### Rating the provider
138-
139-
You can provide rating to the model by clicking on the `Rate the model` radio button. The rating will be captured as part of the metrics and can help the company which model to deploy in production.
140-
141-
### Grafana Dashboard
142-
143-
By default, Grafana application is deployed in `llm-monitoring` namespace. Launch the Grafana Dashboard, by running the following instructions:
144-
145-
- Grab the credentials of Grafana Application
146-
- Navigate to Workloads --> Secrets
147-
- Click on the grafana-admin-credentials and copy the GF_SECURITY_ADMIN_USER, GF_SECURITY_ADMIN_PASSWORD
148-
- Launch Grafana Dashboard
149-
- Click the `Application box` icon in the header, and select `Grafana UI for LLM ratings`
150-
![Launch Application](/images/rag-llm-gitops/launch-application.png)
151-
- Enter the Grafana admin credentials.
152-
- Ratings are displayed for each model.
153-
154-
![Routes](/images/rag-llm-gitops/monitoring.png)
155-
156-
157-
158-
159-
### Deploy application
160-
161-
**Note**: This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
162-
163-
```yaml
164-
---
165-
global:
166-
pattern: rag-llm-gitops
167-
options:
168-
useCSV: false
169-
syncPolicy: Automatic
170-
installPlanApproval: Automatic
171-
# Possible value for db.type = [REDIS, EDB]
172-
db:
173-
index: docs
174-
type: EDB # <--- Default is EDB, Change the db type to REDIS for Redis deployment
175-
main:
176-
clusterGroupName: hub
177-
multiSourceConfig:
178-
enabled: true
179-
```
180-
181119

content/patterns/rag-llm-gitops/rating-the-provider.md

Lines changed: 10 additions & 33 deletions
Original file line numberDiff line numberDiff line change
@@ -6,46 +6,23 @@ aliases: /rag-llm-gitops/getting-started/
66

77
# Rating the provider
88

9-
You can provide rating to the model by clicking on the `Rate the model` radio button. The rating will be captured as part of the metrics and can help the company which model to deploy in production.
9+
You can provide rating to the model by clicking on the `Rate the model` radio button. The rating are captured as part of the metrics and can help the company decide which model to deploy in production.
1010

1111
## Grafana Dashboard
1212

13-
By default, Grafana application is deployed in `llm-monitoring` namespace. Launch the Grafana Dashboard, by running the following instructions:
14-
15-
- Grab the credentials of Grafana Application
16-
- Navigate to Workloads --> Secrets
17-
- Click on the grafana-admin-credentials and copy the GF_SECURITY_ADMIN_USER, GF_SECURITY_ADMIN_PASSWORD
18-
- Launch Grafana Dashboard
19-
- Click the `Application box` icon in the header, and select `Grafana UI for LLM ratings`
20-
![Launch Application](/images/rag-llm-gitops/launch-application.png)
21-
- Enter the Grafana admin credentials.
22-
- Ratings are displayed for each model.
23-
24-
![Routes](/images/rag-llm-gitops/monitoring.png)
13+
By default, the Grafana application is deployed in the `llm-monitoring` namespace. You can track the ratings by logging in to the Grafana Dashboard by following the steps below.
2514

15+
1. In the OpenShift web console go to **Workloads** > **Secrets**.
2616

17+
2. Click on the `ai-llm-grafana-admin-credentials` scroll down.
2718

19+
3. Launch Grafana Dashboard by clicking the `Application box` icon in the header, and select `Grafana UI for LLM ratings`.
2820

29-
### Deploy application
30-
31-
**Note**: This pattern supports two types of vector databases, EDB Postgres for Kubernetes, and Redis. By default the pattern will deploy EDB Postgres for Kubernetes as a vector database. To deploy Redis, change the `global.db.type` parameter to the `REDIS` value in [values-global.yaml](./values-global.yaml).
21+
4. In the top right hand corner click `Sign in`
22+
![Launch Application](/images/rag-llm-gitops/launch-application.png)
3223

33-
```yaml
34-
---
35-
global:
36-
pattern: rag-llm-gitops
37-
options:
38-
useCSV: false
39-
syncPolicy: Automatic
40-
installPlanApproval: Automatic
41-
# Possible value for db.type = [REDIS, EDB]
42-
db:
43-
index: docs
44-
type: EDB # <--- Default is EDB, Change the db type to REDIS for Redis deployment
45-
main:
46-
clusterGroupName: hub
47-
multiSourceConfig:
48-
enabled: true
49-
```
24+
5. Enter the Grafana admin credentials. Copy the `GF_SECURITY_ADMIN_USER`, `GF_SECURITY_ADMIN_PASSWORD` from `ai-llm-grafana-admin-credentials` screen in the OpenShift web console.
5025

26+
6. Ratings are displayed for each model.
5127

28+
![Routes](/images/rag-llm-gitops/monitoring.png)

content/patterns/rag-llm-gitops/rating_the-provider.md

Lines changed: 0 additions & 69 deletions
This file was deleted.
52.4 KB
Loading
-169 KB
Loading

0 commit comments

Comments
 (0)