You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In this article, you import an Amazon Bedrock passthrough language model API into your API Management instance. This is an example of a model that's hosted on an inference provider other than Azure AI services. Use AI gateway policies and other capabilities in API Management to simplify integration, improve observability, and enhance control over the model endpoints.
18
+
In this article, you import an Amazon Bedrock language model API into your API Management instance as a passthrough API. This is an example of a model that's hosted on an inference provider other than Azure AI services. Use AI gateway policies and other capabilities in API Management to simplify integration, improve observability, and enhance control over the model endpoints.
19
19
20
20
Learn more about managing AI APIs in API Management:
21
21
22
-
*[Generative AI gateway capabilities in Azure API Management](genai-gateway-capabilities.md)
22
+
*[AI gateway capabilities in Azure API Management](genai-gateway-capabilities.md)
23
23
*[Import a language model API](openai-compatible-llm-api.md)
24
24
25
25
Learn more about Amazon Bedrock:
@@ -30,7 +30,7 @@ Learn more about Amazon Bedrock:
30
30
## Prerequisites
31
31
32
32
- An existing API Management instance. [Create one if you haven't already](get-started-create-service-instance.md).
33
-
- An Amazon Web Services (AWS) account with access to Amazon Bedrock, and access to an Amazon Bedrock foundation model. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/getting-started-console.html)
33
+
- An Amazon Web Services (AWS) account with access to Amazon Bedrock, and access to one or more Amazon Bedrock foundation models. [Learn more](https://docs.aws.amazon.com/bedrock/latest/userguide/getting-started-console.html)
34
34
35
35
36
36
<!--
@@ -66,7 +66,6 @@ Securely store the two IAM user access keys as secret [named values](api-managem
66
66
67
67
## Import a passthrough language model API using the portal
68
68
69
-
70
69
To import an Amazon Bedrock language model API to API Management:
71
70
72
71
1. In the [Azure portal](https://portal.azure.com), navigate to your API Management instance.
@@ -91,18 +90,17 @@ To import an Amazon Bedrock language model API to API Management:
91
90
1. Select **Review**.
92
91
1. After settings are validated, select **Create**.
93
92
94
-
95
93
API Management creates the API and (optionally) policies to help you monitor and manage the API.
96
94
97
95
## Configure policies to authenticate requests to the Amazon Bedrock API
98
96
99
-
Configure API Management policies at the level of the API that you imported to sign requests to the Amazon Bedrock API.
97
+
Configure API Management policies to sign requests to the Amazon Bedrock API. [Learn more about signing AWS API requests](https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_sigv.html).
100
98
101
99
The following example uses the *accesskey* and *secretkey* named values you created earlier for the AWS access key and secret key. Set the `region` variable to the appropriate values for your Amazon Bedrock API. The example uses `us-east-1` for the region.
102
100
103
101
1. In the [Azure portal](https://portal.azure.com), navigate to your API Management instance.
104
102
1. In the left menu, under **APIs**, select **APIs**.
105
-
1. Select the API that you created in the previous step.
103
+
1. Select the API that you created in the previous section.
106
104
1. In the left menu, under **Design**, select **All operations**.
107
105
1. Select the **Inbound processing** tab.
108
106
1. In the **Inbound processing** policy editor, select **</>** to open the policy editor.
@@ -274,7 +272,7 @@ The following example uses the *accesskey* and *secretkey* named values you crea
274
272
275
273
To call the LLM API through API Management, you can use the AWS Bedrock SDK. This example uses the .NET SDK, but you can use any language that supports the AWS Bedrock API.
276
274
277
-
The following example uses a custom HTTP client that instantiates classes in the accompanying file `BedrockHttpClientFactory.cs`. The custom HTTP client routes requests to the API Management endpoint and includes the API Management subscription key in the request headers.
275
+
The following example uses a custom HTTP client that instantiates classes defined in the accompanying file `BedrockHttpClientFactory.cs`. The custom HTTP client routes requests to the API Management endpoint and includes the API Management subscription key in the request headers.
278
276
279
277
```csharp
280
278
using Amazon;
@@ -330,7 +328,7 @@ var request = new ConverseRequest
330
328
331
329
try
332
330
{
333
-
// Send the request to the Bedrock Runtime and wait for the result.
331
+
// Send the request to the Bedrock runtime and wait for the result.
334
332
var response = await client.ConverseAsync(request);
Copy file name to clipboardExpand all lines: articles/api-management/openai-compatible-llm-api.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,7 +19,7 @@ You can import OpenAI-compatible language model endpoints to your API Management
19
19
20
20
Learn more about managing AI APIs in API Management:
21
21
22
-
*[Generative AI gateway capabilities in Azure API Management](genai-gateway-capabilities.md)
22
+
*[AI gateway capabilities in Azure API Management](genai-gateway-capabilities.md)
23
23
24
24
## Language model API types
25
25
@@ -29,7 +29,7 @@ API Management supports two types of language model APIs for this scenario. Choo
29
29
30
30
API Management configures an OpenAI-compatible chat completions endpoint.
31
31
32
-
***Passthrough** - Other language model endpoints that aren't compatible with OpenAI's API. Examples include models deployed in [Amazon Bedrock](https://docs.aws.amazon.com/bedrock/latest/userguide/what-is-bedrock.html) or other providers.
32
+
***Passthrough** - Other language model endpoints that aren't compatible with OpenAI's API. Examples include models deployed in [Amazon Bedrock](amazon-bedrock-passthrough-llm-api.md) or other providers.
33
33
34
34
API Management configures wildcard operations for common HTTP verbs. Clients can append paths to the wildcard operations, and API Management passes requests to the backend.
0 commit comments