You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/developer-lightspeed/con-about-lightspeed-stack-and-llama-stack.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ The {lcs-name} and Llama Stack deploy together as sidecar containers to augment
7
7
8
8
The {lcs-name} serves as the Llama Stack service intermediary, managing configurations for key components. These components include the large language model (LLM) inference providers, Model Context Protocol (MCP) or retrieval augmented generation (RAG) tool runtime providers, safety providers, and vector database settings.
9
9
10
-
* {lcs-name} manages authentication, user feedback collection, MCP server configuration, and caching.
10
+
* {lcs-name} manages user feedback collection, MCP server configuration, and conversation history.
11
11
12
12
* Llama Stack provides the inference functionality that {lcs-short} uses to process requests. For more information, see https://llamastack.github.io/docs#what-is-llama-stack[What is Llama Stack].
= Customizing the chat history storage in {ls-short}
5
5
6
-
By default, the {ls-short} service stores chat history using an in-memory database. This means that if you restart the Pod containing the server, the chat history is lost. You can manually configure {ls-short} to store the chat history persistently as a long-term backup with PostgreSQL by any of the following methods:
7
-
8
-
* {product-very-short} Operator
9
-
* {product-very-short} Helm chart
6
+
By default, the {ls-short} service stores chat history in a non-persistent local SQL database within in the {lcs-short} container. This means that chat history is lost if you create and use a new {lcs-short} sidecar. You can manually configure {ls-short} to store the chat history persistently as a long-term backup with PostgreSQL by updating your {lcs-short} service configuration.
10
7
11
8
+
12
9
[WARNING]
13
10
====
14
-
If you configure {ls-short} to store chat history using PostgreSQL, prompts and responses are recorded and can be reviewed by your platform administrators. If any of your user's chat history contains any private, sensitive, or confidential information, this might have data privacy and security implications that you need to assess. For users that wish to have their chat data removed, they must request their respective platform administrator to perform this action. {company-name} does not collect (or have access to) any of this chat history data.
11
+
Configuring {ls-short} to use PostgreSQL records prompts and responses, which platform administrators can review. You must assess any data privacy and security implications if user chat history contains private, sensitive, or confidential information. For users that wish to have their chat data removed, they must request their respective platform administrator to perform this action. {company-name} does not collect or access this chat history data.
15
12
====
16
13
17
14
.Procedure
18
-
Customize the chat history storage using any of the following methods:
19
-
20
-
* Update your {product-very-short} config file.
21
-
** If you are using {ls-short} on an Operator-installed {product-very-short} instance, update `conversation_cache` in your {product-very-short} ConfigMap.
22
-
** If you are using {ls-short} on a Helm-installed {product-very-short} instance, update `conversation_cache` in your `values.yaml` file.
15
+
. Configure the chat history storage type in the {lcs-short} configuration file (`lightspeed-stack.yaml`) using any of the relevant options:
16
+
** To enable persistent storage with PostgreSQL, add the following configuration:
23
17
+
24
18
[source,yaml]
25
19
----
@@ -29,18 +23,17 @@ Customize the chat history storage using any of the following methods:
29
23
host: _<your_database_host>_
30
24
port: _<your_database_port>_
31
25
db: _<your_database_name>_
32
-
user: _<your_user_name>_
33
-
password: _<postgres_password>_
34
-
ca_cert_path: postgres_cert.crt
35
-
ssl_mode: "require"
26
+
user: _<your_user_name>_
27
+
password: _<postgres_password>_
36
28
----
37
-
38
-
* Update `conversation_cache` in your {lcs-short} config file:
29
+
* To retain the default, non-persistent SQLite storage, make sure the configuration is set as shown in the following example:
39
30
+
40
31
[source,yaml]
41
32
----
42
-
conversation_cache:
43
-
type: "sqlite"
44
-
sqlite:
45
-
db_path: "/tmp/cache.db"
33
+
conversation_cache:
34
+
type: "sqlite"
35
+
sqlite:
36
+
db_path: "/tmp/cache.db"
46
37
----
38
+
39
+
. Restart your {lcs-short} service to apply the new configuration.
Copy file name to clipboardExpand all lines: modules/developer-lightspeed/proc-installing-and-configuring-lightspeed.adoc
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -34,7 +34,7 @@ You must manually install and configure the {ls-short} plugin, the {lcs-name} ({
34
34
35
35
.. In the {ocp-short} web console, navigate to your {product-very-short} instance and select the *ConfigMaps* tab.
36
36
.. Click *Create ConfigMaps*.
37
-
.. From the *Create ConfigMap* page, select the *YAML view* option and edit the file using the following structure. This example demonstrates the configuration for the LCS ConfigMap, typically named `lightspeed-stack`, which connects to the Llama Stack service locally on port `8321`:
37
+
.. From the *Create ConfigMap* page, select the *YAML view* option and edit the file using the following structure. This example demonstrates the configuration for the {lcs-short} ConfigMap, typically named `lightspeed-stack`, which connects to the Llama Stack service locally on port `8321`:
38
38
+
39
39
[source,yaml]
40
40
----
@@ -47,7 +47,7 @@ data:
47
47
name: Lightspeed Core Service (LCS)
48
48
service:
49
49
host: 0.0.0.0
50
-
port: 8080
50
+
port: ${LIGHTSPEED_SERVICE_PORT}
51
51
auth_enabled: false
52
52
workers: 1
53
53
color_log: true
@@ -376,7 +376,7 @@ You must replace the older single container configuration found in source with t
376
376
----
377
377
... Click *Save* and then Helm upgrade.
378
378
379
-
. Manage authorization (RBAC): If you have users who are not administrators, you must define permissions and roles for them to use {ls-short}. The Lightspeed Backend plugin uses {backstage} RBAC for authorization.
379
+
. Optional: Manage authorization (RBAC): If you have users who are not administrators, you must {authorization-book-link}##enabling-and-giving-access-to-rbac[define permissions and roles] for them to use {ls-short}. The Lightspeed Backend plugin uses {backstage} RBAC for authorization.
380
380
381
381
** For an Operator-installed {product-very-short} instance:
Copy file name to clipboardExpand all lines: modules/developer-lightspeed/proc-using-developer-lightspeed-to-start-a-chat-for-the-first-time.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@
5
5
6
6
You can start a chat with {ls-short} for quick answers on a number of topics depending on your settings. You can manually start a chat with the {ls-short} or use the following sample prompts we have provided to help you get started:
7
7
8
-
* *Getting Started with {product-custom-resource-type}*
0 commit comments