Skip to content

Commit 38175a6

Browse files
committed
RC Langcache: Add Redis Embedding provider and other UX changes
1 parent 2ff439c commit 38175a6

File tree

6 files changed

+16
-12
lines changed

6 files changed

+16
-12
lines changed

content/operate/rc/langcache/create-service.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ LangCache does not support the following databases during public preview:
2626
- Databases with the [default user]({{< relref "/operate/rc/security/access-control/data-access-control/default-user" >}}) turned off
2727
{{< /note >}}
2828

29-
- An [OpenAI API key](https://platform.openai.com/api-keys). LangCache uses OpenAI to generate embeddings for prompts and responses.
29+
- An API key for your embedding provider, if not using the default Redis embedding provider. LangCache supports [OpenAI](https://platform.openai.com/api-keys) and the Redis embedding provider during public preview.
3030

3131
## Create a LangCache service
3232

@@ -67,10 +67,10 @@ The **Embedding settings** section defines the embedding model used by your serv
6767

6868
| Setting name |Description|
6969
|:----------------------|:----------|
70-
| **Supported Embedding Provider** | The embedding provider to use for your service. LangCache only supports OpenAI during public preview. |
71-
| **Embedding provider API key** | Enter your embedding provider's API key. |
70+
| **Embedding Provider** | The embedding provider to use for your service. Select between `Redis` and `OpenAI`. |
71+
| **Embedding provider API key** | Enter your embedding provider's API key if not using the default Redis embedding provider. |
7272
| **Model** | Select the embedding model to use for your service. |
73-
| **Similarity threshold** | Set the minimum similarity score required to consider a cached response a match. Range: `0.5` to `1.0`. Default: `0.9`<br/><br/>A higher value means more precise matches, but if it's too high, you will compromise on the number of matches and may lose relevant matches. A lower value means more matches, but may include less relevant matches. We recommend starting between `0.8` and `0.9` and then fine-tuning based on your results. |
73+
| **Similarity threshold** | Set the minimum similarity score required to consider a cached response a match. Range: `0.5` to `1.0`. Default: `0.85`<br/><br/>A higher value means more precise matches, but if it's too high, you will compromise on the number of matches and may lose relevant matches. A lower value means more matches, but may include less relevant matches. We recommend starting between `0.8` and `0.9` and then fine-tuning based on your results. |
7474

7575
### Attributes settings
7676

@@ -111,7 +111,7 @@ A window containing your LangCache service key will appear. Select **Copy** to c
111111
{{<warning>}}
112112
This is the only time the value of the user key is available. Save it to a secure location before closing the dialog box.<br/><br/>
113113

114-
If you lose the service key value, you will need to [replace the service key]({{< relref "/operate/rc/langcache/view-edit-cache#replace-service-api-key" >}}) to be able to use the LangCache API.
114+
If you lose the service key value, you will need to [generate a new service key]({{< relref "/operate/rc/langcache/view-edit-cache#replace-service-api-key" >}}) to be able to use the LangCache API.
115115
{{</warning>}}
116116

117117
You'll be taken to your LangCache service's **Configuration** page. You'll also be able to see your LangCache service in the LangCache service list.

content/operate/rc/langcache/view-edit-cache.md

Lines changed: 11 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -39,17 +39,17 @@ The **Connectivity** section provides the connection details for your LangCache
3939
| **Cache ID** | The unique ID of your LangCache service. |
4040
| **API Base URL** | The base URL for LangCache API requests. |
4141

42-
Select the **Copy** button next to the Cache ID and API Base URL to copy them to the clipboard. If you lost the API key value or need to rotate the key, you can [replace the service API key](#replace-service-api-key) at any time.
42+
Select the **Copy** button next to the Cache ID and API Base URL to copy them to the clipboard. If you lost the API key value or need to rotate the key, you can [generate a new service API key](#replace-service-api-key) at any time.
4343

4444
See [use the LangCache API]({{< relref "/operate/rc/langcache/use-langcache" >}}) for more information on how to use these values.
4545

46-
#### Replace service API key
46+
#### Generate a new service API key {#replace-service-api-key}
4747

48-
The API key is only available immediately after you create the LangCache service. If you lost this value, or need to rotate the key, you can replace the service key at any time.
48+
The API key is only available immediately after you create the LangCache service. If you lost this value, or need to rotate the key, you can generate a new service key at any time.
4949

50-
To replace the service key:
50+
To generate a new service key:
5151

52-
1. Select **Replace key**.
52+
1. Select **Generate key**.
5353

5454
{{<image filename="images/rc/langcache-replace-key.png" alt="The Replace Key button." >}}
5555

@@ -60,9 +60,11 @@ To replace the service key:
6060
{{<image filename="images/rc/langcache-service-key.png" alt="The LangCache service key window. Use the Copy button to save the service key to the clipboard." >}}
6161

6262
{{<warning>}}
63+
After you generate a new service key, calls to the LangCache API with the old key will fail. <br/><br/>
64+
6365
This is the only time the value of the user key is available. Save it to a secure location before closing the dialog box. <br/><br/>
6466

65-
If you lose the service key value, you will need to replace the key again.
67+
If you lose the service key value, you will need to generate a new key again.
6668
{{</warning>}}
6769

6870
### General
@@ -77,7 +79,9 @@ The **General** section provides configuration details for your LangCache servic
7779
| **Database** | The database that stores your cache data. |
7880
| **Similarity threshold** | The minimum similarity score required to consider a cached response a match. _(Editable)_ |
7981
| **TTL** | The number of seconds to cache entries before they expire. _(Editable)_ |
80-
| **Embedding Provider** | The embedding provider to use for your service. |
82+
| **Embedding Provider** | The embedding provider used for your service. |
83+
| **Embedding Model** | The embedding model used for your service. |
84+
| **Embedding Model API key** | The obfuscated API key for the embedding provider. |
8185

8286
Some of these settings can be changed after cache creation. To do so, select the **Edit** button.
8387

3.99 KB
Loading
-62 Bytes
Loading
-8.59 KB
Loading
4.51 KB
Loading

0 commit comments

Comments
 (0)