Skip to content

Quick: Write manifest in tempfile instead of on Corral#1695

Merged
jarosenb merged 4 commits intomainfrom
quick/20260130-tempfile-for-manifest
Feb 3, 2026
Merged

Quick: Write manifest in tempfile instead of on Corral#1695
jarosenb merged 4 commits intomainfrom
quick/20260130-tempfile-for-manifest

Conversation

@jarosenb
Copy link
Copy Markdown
Member

Overview:

The current manifest-generating code writes directly to our Corral mount. If there are >100,000 files, this can result in us holding an open file descriptor on an NFS mount for several hours. The longer we hold the file open, the more likely it is to go stale and throw a write error. This PR changes the method to use a tempfile on the host filesystem, which should be more stable.

PR Status:

  • Ready.
  • Work in Progress.
  • Hold.

Notes:

@jarosenb jarosenb merged commit ff12545 into main Feb 3, 2026
5 of 10 checks passed
@jarosenb jarosenb deleted the quick/20260130-tempfile-for-manifest branch February 3, 2026 00:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants