Skip to content

Conversation

vasil-pashov
Copy link
Collaborator

@vasil-pashov vasil-pashov commented Aug 29, 2025

Reference Issues/PRs

Monday 9796087821

What does this implement or fix?

The issue is that we need to output a dense dataframe for Pandas. So if the date range is big and the frequency is small we can end up with too many rows in the output dataframe eating the memory of the runner.

This also allows us to test all possible frequencies and extend the date range for generating dataframes.

Any other comments?

Checklist

Checklist for code changes...
  • Have you updated the relevant docstrings, documentation and copyright notice?
  • Is this contribution tested against all ArcticDB's features?
  • Do all exceptions introduced raise appropriate error messages?
  • Are API changes highlighted in the PR description?
  • Is the PR labelled as enhancement or bug so it appears in autogenerated release notes?

@vasil-pashov vasil-pashov added patch Small change, should increase patch version no-release-notes This PR shouldn't be added to release notes. labels Aug 29, 2025
@vasil-pashov vasil-pashov changed the title Fix hypothesis tests that occasionally make the CI runners OOM Fix hypothesis tests that occasionally make the CI runners OOM [9796087821] Aug 29, 2025
@vasil-pashov vasil-pashov force-pushed the vasil.pashov/fix-oom-flaky-resampling branch 3 times, most recently from c27166a to a081149 Compare August 29, 2025 08:32
The issue is that we need to output a dense dataframe for Pandas. So if
the date range is big and the frequency is small we can end up with too
many rows in the output dataframe eating the memory of the runner.

This also allows us to test all possible frequencies and extend the date
range for generating dataframes.
@vasil-pashov vasil-pashov force-pushed the vasil.pashov/fix-oom-flaky-resampling branch from a081149 to c28301d Compare August 29, 2025 08:49
@vasil-pashov vasil-pashov merged commit 9169d2b into master Sep 23, 2025
273 of 274 checks passed
@vasil-pashov vasil-pashov deleted the vasil.pashov/fix-oom-flaky-resampling branch September 23, 2025 13:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-release-notes This PR shouldn't be added to release notes. patch Small change, should increase patch version
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants