Skip to content

Conversation

@srh
Copy link
Contributor

@srh srh commented Mar 24, 2025

Makes the test wait for or induce compaction first. In release mode the test had been failing.

Cherry-picked from the DF upgrade branch.

Check List

  • Tests have been run in packages where changes made if available
  • Linter has been run for changed code
  • Tests for the changes have been added if not covered yet
  • Docs have been added / updated if required

@srh srh requested a review from a team as a code owner March 24, 2025 00:44
Makes the test wait for or induce compaction first.  In release mode
the test had been failing.

Cherry-picked from the DF upgrade branch.
@srh srh force-pushed the testfix-decimal_partition_pruning branch from d83614d to c75514f Compare March 24, 2025 00:53
.unwrap();
// Semi-busy-wait for, or, seemingly, induce, compaction for 2000 ms.
let num_attempts = 100;
for i in 0..num_attempts {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe it's better to use JobResultListener and wait_for_job_results here or metastore listener.

cC @waralexrom @waralex

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not clear to me what job to wait for. Based on logs, some sort of PartitionCompaction job. But I don't know the right way to see which ones I want to wait on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants