Skip to content

Commit 5fb24f7

Browse files
committed
add note for permissions required to use inference profiles
1 parent 67d1f6a commit 5fb24f7

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

integrations/llms/bedrock/aws-bedrock.mdx

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -631,6 +631,14 @@ Note that you will have to set [`strict_open_ai_compliance=False`](/product/ai-g
631631
```
632632
</CodeGroup>
633633

634+
## Inference Profiles
635+
636+
[Inference profiles](https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles.html) are a resource in Amazon Bedrock that define a model and one or more Regions to which the inference profile can route model invocation requests.
637+
638+
To use inference profiles, your IAM role needs to have the following permissions:
639+
https://docs.aws.amazon.com/bedrock/latest/userguide/inference-profiles-prereq.html
640+
641+
634642
## Bedrock Converse API
635643

636644
Portkey uses the [AWS Converse API](https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html) internally for making chat completions requests.

0 commit comments

Comments
 (0)