Skip to content

Commit 9bb53a5

Browse files
committed
Minor changes
1 parent d27ef23 commit 9bb53a5

File tree

2 files changed

+5
-8
lines changed

2 files changed

+5
-8
lines changed

modules/developer-lightspeed/proc-changing-your-llm-provider.adoc

Lines changed: 3 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -5,14 +5,11 @@
55

66
{ls-short} operates on a {developer-lightspeed-link}#con-about-bring-your-own-model_appendix-about-user-data-security[_Bring Your Own Model_] approach, meaning you must provide and configure access to your preferred Large Language Model (LLM) provider for the service to function. The Road-Core Service (RCS) acts as an intermediary layer that handles the configuration and setup of these LLM providers.
77

8-
[NOTE]
9-
====
10-
Currently, only single LLM server is supported.
11-
====
12-
138
[IMPORTANT]
149
====
15-
The LLM provider configuration section includes a mandatory dummy provider block. Due to limitations of Road Core, this dummy provider must remain present when working with Lightspeed. This block is typically marked with comments (# Start: Do not remove this block and # End: Do not remove this block) and must not be removed from the configuration file.
10+
* The LLM provider configuration section includes a mandatory dummy provider block. Due to limitations of Road Core, this dummy provider must remain present when working with Lightspeed. This block is typically marked with comments (# Start: Do not remove this block and # End: Do not remove this block) and must not be removed from the configuration file.
11+
12+
* Only one LLM server is supported in Developer preview.
1613
====
1714

1815
.Prerequisites

modules/developer-lightspeed/proc-installing-and-configuring-lightspeed.adoc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ data:
2929
rcsconfig.yaml: |
3030
llm_providers:
3131
# Start: Do not remove this block
32-
# Currently, you can only configure a single LLM server.
32+
# Only one LLM server is supported in Developer preview
3333
- name: dummy
3434
type: openai
3535
url: https://dummy.com
@@ -74,7 +74,7 @@ data:
7474
====
7575
* Do not remove the block in the `llm_providers` section. This requirement is crucial when working with {ls-short} because of limitations discovered in Road Core. If you decide to use an alternative LLM provider, you should refer to additional information in the guide. For more information, see {developer-lightspeed-link}#proc-changing-your-llm-provider_customizing-developer-lightspeed[Changing your LLM provider].
7676
77-
* Currently, you can only configure a single LLM server
77+
* Only one LLM server is supported in Developer preview.
7878
====
7979
.. Optional: Configure the number of workers that scale the REST API by specifying the following example to the `ols_config.max_workers` parameter in the {rcs-short} ConfigMap.
8080
+

0 commit comments

Comments
 (0)