Area
SDK
Problem or motivation
While Opfor supports several popular providers, many organizations deploy
models through platforms such as AWS Bedrock and Google Vertex AI. These
platforms have their own authentication mechanisms and request formats, making
them difficult to use through the current provider options.
First-class support would simplify evaluating agents deployed in enterprise
environments.
Proposed solution
Add provider implementations for:
- AWS Bedrock
- Google Vertex AI
- IBM watsonx.ai
- Cloudflare Workers AI
Each provider should integrate with the existing provider abstraction so users
can select it from the CLI or configuration file without modifying evaluators.
Area
SDK
Problem or motivation
While Opfor supports several popular providers, many organizations deploy
models through platforms such as AWS Bedrock and Google Vertex AI. These
platforms have their own authentication mechanisms and request formats, making
them difficult to use through the current provider options.
First-class support would simplify evaluating agents deployed in enterprise
environments.
Proposed solution
Add provider implementations for:
Each provider should integrate with the existing provider abstraction so users
can select it from the CLI or configuration file without modifying evaluators.