Skip to content

Conversation

@NGA-TRAN
Copy link
Collaborator

@NGA-TRAN NGA-TRAN commented Jul 18, 2025

Changes in this PR:

  1. Use recent commit in DF to get the fix for TPC-H Q16 fails during deserialization apache/datafusion#16665
  2. Add serialization and deserialization tests on physical plans because they are so important in our distributed system

Note: I added small tpc-h parquet files (20 rows each file) to ensure we simulate exact schema. The data will be good for testing correctness that I plan to do next, too


/// Test that we are able to build the physical plan and its version after serialization and deserialization
#[tokio::test]
async fn test_serialize_deserialize_tpch_queries() -> Result<()> {
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test will fail without recent commit from DF

@NGA-TRAN NGA-TRAN merged commit d7a5491 into main Jul 21, 2025
3 checks passed
@NGA-TRAN NGA-TRAN deleted the ntran/dftest branch July 21, 2025 19:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants