Skip to content

Commit d27ef23

Browse files
committed
Adding further changes
1 parent e3e9e5c commit d27ef23

File tree

2 files changed

+9
-1
lines changed

2 files changed

+9
-1
lines changed

modules/developer-lightspeed/proc-changing-your-llm-provider.adoc

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,11 @@
55

66
{ls-short} operates on a {developer-lightspeed-link}#con-about-bring-your-own-model_appendix-about-user-data-security[_Bring Your Own Model_] approach, meaning you must provide and configure access to your preferred Large Language Model (LLM) provider for the service to function. The Road-Core Service (RCS) acts as an intermediary layer that handles the configuration and setup of these LLM providers.
77

8+
[NOTE]
9+
====
10+
Currently, only single LLM server is supported.
11+
====
12+
813
[IMPORTANT]
914
====
1015
The LLM provider configuration section includes a mandatory dummy provider block. Due to limitations of Road Core, this dummy provider must remain present when working with Lightspeed. This block is typically marked with comments (# Start: Do not remove this block and # End: Do not remove this block) and must not be removed from the configuration file.

modules/developer-lightspeed/proc-installing-and-configuring-lightspeed.adoc

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@ data:
2929
rcsconfig.yaml: |
3030
llm_providers:
3131
# Start: Do not remove this block
32+
# Currently, you can only configure a single LLM server.
3233
- name: dummy
3334
type: openai
3435
url: https://dummy.com
@@ -71,7 +72,9 @@ data:
7172
+
7273
[IMPORTANT]
7374
====
74-
Do not remove the block in the `llm_providers` section. This requirement is crucial when working with {ls-short} because of limitations discovered in Road Core. If you decide to use an alternative LLM provider, you should refer to additional information in the guide. For more information, see link:{developer-lightspeed-link}#proc-changing-your-llm-provider[Changing your LLM provider].
75+
* Do not remove the block in the `llm_providers` section. This requirement is crucial when working with {ls-short} because of limitations discovered in Road Core. If you decide to use an alternative LLM provider, you should refer to additional information in the guide. For more information, see {developer-lightspeed-link}#proc-changing-your-llm-provider_customizing-developer-lightspeed[Changing your LLM provider].
76+
77+
* Currently, you can only configure a single LLM server
7578
====
7679
.. Optional: Configure the number of workers that scale the REST API by specifying the following example to the `ols_config.max_workers` parameter in the {rcs-short} ConfigMap.
7780
+

0 commit comments

Comments
 (0)