Skip to content

Fix some stuff with large files and file collections#86

Closed
ApfelTeeSaft wants to merge 2 commits intowimpysworld:mainfrom
ApfelTeeSaft:main
Closed

Fix some stuff with large files and file collections#86
ApfelTeeSaft wants to merge 2 commits intowimpysworld:mainfrom
ApfelTeeSaft:main

Conversation

@ApfelTeeSaft
Copy link

No description provided.

@flexiondotorg
Copy link
Member

@cubic review this pull request

@cubic-dev-ai
Copy link
Contributor

cubic-dev-ai bot commented Jan 21, 2026

@cubic review this pull request

@flexiondotorg I have started the AI code review. It will take a few minutes to complete.

Copy link
Contributor

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 2 files

flexiondotorg added a commit that referenced this pull request Jan 22, 2026
- Add automatic retry mechanism with exponential backoff (3 retries max)
- Implement automatic resume on retry by re-checking file size
- Extend connection timeout to 10 minutes for large file downloads
- Add connection pooling and TCP keepalive settings
- Refactor download_file_content to handle transient network errors
- Simplify function signature by removing explicit file_size parameter

Addresses issues:
- #76: Large files downloading with incorrect size/hash errors
- #89: Connection errors during download ('error decoding response body')

Changes from PR #86 by @ApfelTeeSaft
flexiondotorg added a commit that referenced this pull request Jan 22, 2026
- Add automatic retry mechanism with exponential backoff (3 retries max)
- Implement automatic resume on retry by re-checking file size
- Extend connection timeout to 10 minutes for large file downloads
- Add connection pooling and TCP keepalive settings
- Refactor download_file_content to handle transient network errors
- Simplify function signature by removing explicit file_size parameter

Addresses issues:
- #76: Large files downloading with incorrect size/hash errors
- #89: Connection errors during download ('error decoding response body')

Changes from PR #86 by @ApfelTeeSaft
@flexiondotorg
Copy link
Member

Thanks @ApfelTeeSaft 🙇 This pull request was incorporated in #91

flexiondotorg added a commit that referenced this pull request Jan 22, 2026
* feat: add retry logic and extended timeouts for large file downloads

- Add automatic retry mechanism with exponential backoff (3 retries max)
- Implement automatic resume on retry by re-checking file size
- Extend connection timeout to 10 minutes for large file downloads
- Add connection pooling and TCP keepalive settings
- Refactor download_file_content to handle transient network errors
- Simplify function signature by removing explicit file_size parameter

Addresses issues:
- #76: Large files downloading with incorrect size/hash errors
- #89: Connection errors during download ('error decoding response body')

Changes from PR #86 by @ApfelTeeSaft

* fix: use HTTP_TIMEOUT constant instead of magic number

---------

Co-authored-by: Martin Wimpress <martin@wimpress.org>
Co-authored-by: cubic-dev-ai[bot] <1082092+cubic-dev-ai[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants