创建AI服务提供者，希望提供自定义endpoint || Create an AI service provider, hoping to provide a custom endpoint

[forhead]

我们在私有化部署模型的时候，服务地址是自定义的endpoint，希望可以支持自定义endpint。

---

When we deploy the model privately, the service address is a custom endpoint, and we hope to support customized endpints.

[johnlanni]

用openai兼容服务就可以

[forhead]

抱歉，我这边提交截图错误了。我们是希望配置aws bedrock。

---

Sorry, I submitted the screenshot wrong here. We want to configure aws bedrock.

[forhead]

@johnlanni

[CH3CHO]

可以自定义endpoint

自定义什么样的 endpoint 呢，能举个例子吗，以及这个 endpoint 后面是怎么配置的呢？

---

You can customize the endpoint

What kind of endpoint can be customized? Can you give an example, and how is this endpoint configured after it?

[KarlManong]

会创建类似这样的vpce-{id}.bedrock-runtime.us-east-1.vpce.amazonaws.com endpoint 。当用python sdk时，那么

import boto3
from botocore.config import Config

client = boto3.client(
    service_name='bedrock-runtime',
    config=Config(region_name=region_name),
    aws_access_key_id=aws_access_key_id,
    aws_secret_access_key=aws_secret_access_key,
    endpoint_url=bedrock_endpoint_url
)

bedrock_endpoint_url为上述endpoint

[CH3CHO]

这个可以支持，只是说你们要怎么配置一个自定义的地址去指向 AWS 的服务呢？

---

This can be supported, but it just means how do you configure a custom address to point to AWS services?

[KarlManong]

这个可以支持，只是说你们要怎么配置一个自定义的地址去指向 AWS 的服务呢？

This can be supported, but it just means how do you configure a custom address to point to AWS services?

与其他可以独立配置地址的provider类似

---

This can be supported, but it just says how do you configure a custom address to point to AWS services?

This can be supported, but it just means how do you configure a custom address to point to AWS services?

Similar to other providers that can independently configure addresses

[CH3CHO]

这个可以支持，只是说你们要怎么配置一个自定义的地址去指向 AWS 的服务呢？
This can be supported, but it just means how do you configure a custom address to point to AWS services?

与其他可以独立配置地址的provider类似

This can be supported, but it just says how do you configure a custom address to point to AWS services?
This can be supported, but it just means how do you configure a custom address to point to AWS services?

Similar to other providers that can independently configure addresses

我的意思是，这个自定义的地址你们准备怎么让它实际请求走到AWS服务上？