Skip to content

RisingWave state store cannot access S3 when using EKS Pod Identity #24791

@jwan6060

Description

@jwan6060

Describe the bug

We are deploying RisingWave on EKS and configuring the state store to use S3. When using EKS Pod Identity, RisingWave fails to access the S3 bucket for the state store.

It appears that RisingWave is unable to obtain AWS credentials via the Pod Identity mechanism.

Error message/log

thread 'main' (1) panicked at src/compute/src/server.rs:241:6:
called `Result::unwrap()` on an `Err` value: Hummock error: Read backup error: Hummock error: Other error: BackupStorage error: PermissionDenied (permanent) at read, context: { service: s3, path: hummock/backup/manifest.json, range: 0- } => no valid credential found and anonymous access is not allowed

To Reproduce

stateStore:
s3:
enabled: true
region: "ap-southeast-2"
bucket: "{{s3_bucket}}"
authentication:
useServiceAccount: true

Expected behavior

Successfully connect to S3

How did you deploy RisingWave?

Helm on EKS

The version of RisingWave

v2.7.2

Additional context

Related threads: #20305 & apache/opendal#4903

Metadata

Metadata

Assignees

No one assigned

    Labels

    type/bugType: Bug. Only for issues.

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions