Skip to content

Increase I/O operation timeout for S3 #17

@Alan-Liang

Description

@Alan-Liang

The timeout layer in "opendal" defaults to a I/O timeout of 10 s, which is not enough for some large files.

logs
2025-11-07T03:21:41.692056Z  INFO rsync_fetcher::rsync::receiver: receiver started.
2025-11-07T03:22:43.568357Z  WARN opendal::layers::retry: will retry after 1s because: Unexpected (temporary) at Writer::write, context: { timeout: 10 } => io operation timeout reached    
2025-11-07T03:22:54.571822Z  WARN opendal::layers::retry: will retry after 2s because: Unexpected (temporary) at Writer::write, context: { timeout: 10 } => io operation timeout reached    
2025-11-07T03:23:00.654269Z  WARN opendal::layers::retry: will retry after 1s because: Unexpected (temporary) at Writer::write, context: { timeout: 10 } => io operation timeout reached    
2025-11-07T03:23:06.920580Z  WARN opendal::layers::retry: will retry after 4s because: Unexpected (temporary) at Writer::write, context: { timeout: 10 } => io operation timeout reached    
2025-11-07T03:23:11.656872Z  WARN opendal::layers::retry: will retry after 2s because: Unexpected (temporary) at Writer::write, context: { timeout: 10 } => io operation timeout reached    
2025-11-07T03:23:16.953716Z  WARN opendal::layers::retry: will retry after 1s because: Unexpected (temporary) at Writer::write, context: { timeout: 10 } => io operation timeout reached    
2025-11-07T03:23:21.168122Z  INFO rsync_fetcher::rsync::uploader: uploader dropped
Error: 
   0: Unexpected (persistent) at Writer::write, context: { timeout: 10 } => io operation timeout reached

Location:
   rsync-fetcher/src/rsync/uploader.rs:152

We need to increase the timeout specified in

.layer(TimeoutLayer::new())

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions