S3 Connector: Add Support for IAM Roles Anywhere

[taabrcr]

Description:
The current implementation of the Airbyte S3 connector does not support AWS IAM Roles Anywhere, which limits the flexibility and security of accessing S3 resources. Adding this support would allow for more dynamic and secure access management by leveraging IAM Roles Anywhere.

Feature Request:
Support for AWS IAM Roles Anywhere in the S3 connector.

Background:
IAM Roles Anywhere is a feature provided by AWS that enables you to use IAM roles with your applications outside of AWS to make secure API requests to AWS services. This is particularly useful for on-premises or hybrid cloud environments where AWS SDKs or CLI are used but the applications are not running on AWS infrastructure.

Benefits:

• Enhanced Security: By using IAM Roles Anywhere, applications can leverage short-lived credentials and assume roles to access S3, reducing the risk associated with long-term credentials.
• Flexibility: It allows applications running outside of AWS (e.g., on-premises or in other cloud environments) to securely access S3 without managing static credentials.
• Compliance: Helps in meeting compliance requirements by using IAM roles to access AWS services from outside AWS.

Proposed Solution:

• Configuration Options: Introduce new configuration options in the S3 connector to support IAM Roles Anywhere, such as specifying the role ARN, trust anchor, and other necessary parameters.
• Credential Retrieval: Implement the logic to retrieve and use the credentials provided by IAM Roles Anywhere within the S3 connector.

Steps to Reproduce:

• Attempt to configure the S3 connector to use IAM Roles Anywhere.
• Observe that there is no current option to set up IAM Roles Anywhere credentials.

Additional Context:

Providing support for IAM Roles Anywhere would align the Airbyte S3 connector with modern security best practices and AWS's latest features for access management. This feature is especially important for organizations adopting hybrid or multi-cloud strategies.

Priority:

Medium

Affected Components:

S3 Connector