-
-
Notifications
You must be signed in to change notification settings - Fork 700
Open
Description
Hi! I've published a new LLM plugin for AWS Bedrock Converse API:
Plugin: llm-bedrock-converse
PyPI: https://pypi.org/project/llm-bedrock-converse/
GitHub: https://github.com/geehexx/llm-bedrock-converse
Features
- Full Converse API integration with tool/function calling support
- Streaming and non-streaming responses
- All Claude 3, 3.5, and 4 model variants
- Cross-region and global inference profiles
- Multi-modal support (images, PDFs, videos)
- Amazon Titan embedding models (v1 and v2)
- Automatic retry logic with exponential backoff
- 83% test coverage with comprehensive test suite
Installation
llm install llm-bedrock-converseUsage
# Basic usage
llm -m bc-haiku "Hello"
# With tool calling
llm -m bc-sonnet-3.5 -T llm_time "What time is it?"
# Embeddings
llm embed -m titan-v2 -c "Hello world"Would you be willing to add this to the plugin directory under the "Remote APIs" section? It provides comprehensive Bedrock Converse API support with tool calling, which complements the existing llm-bedrock plugins.
Thanks!
Metadata
Metadata
Assignees
Labels
No labels