Error in TPC-H q15 and q16

[NGA-TRAN]

While working on TPC-H result validation #32, I have found q15 (due to view creation) and q16 fail. Here are the details:

q15 that includes a view creation and then a query

Error: which is expected . We may need to find a better way to test this query

Error: INTERNAL: [FlightSQL] Could not prepare query DataFusionError(NotImplemented("The context currently only supports a single SQL statement")) (Internal; ExecuteQuery)

q16

Error: INTERNAL: [FlightSQL] Could not prepare query Other(Failed to send action to worker

Caused by:
    0: Tonic error: status: Internal, message: "[flickering-cassowary], Could not add plan: Other([flickering-cassowary], Could not decode plan for query_id a2508d19-7bcb-453d-a75f-26e96d296a46 stage 1\n\nCaused by:\n    Internal error: The data type inlist should be same, the value type is Utf8View, one of list expr type is Int32.\n    This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker)", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Tue, 01 Jul 2025 16:30:24 GMT", "content-length": "0"} }
    1: status: Internal, message: "[flickering-cassowary], Could not add plan: Other([flickering-cassowary], Could not decode plan for query_id a2508d19-7bcb-453d-a75f-26e96d296a46 stage 1\n\nCaused by:\n    Internal error: The data type inlist should be same, the value type is Utf8View, one of list expr type is Int32.\n    This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker)", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Tue, 01 Jul 2025 16:30:24 GMT", "content-length": "0"} }) (Internal; ExecuteQuery)

[NGA-TRAN]

Update: Q15 now passes in this branch commit (need to merge) to create view at cluster startup

[NGA-TRAN]

I have narrowed down the reproducer for q16 and got the smallest query that hits the same bug.
Note: The number of items in the list must be 4 and over to hit the bug

>>> sql = "select p_brand from part where p_size in (14, 6, 5, 31)"

>>> run_sql(sql)
Error executing SQL query: INTERNAL: [FlightSQL] Could not prepare query Other(Failed to send action to worker

Caused by:
    0: Tonic error: status: Internal, message: "[spiffy-clam], Could not add plan: Other([spiffy-clam], Could not decode plan for query_id 7132cd32-b7ba-4221-b857-5033f21a327f stage 0\n\nCaused by:\n    Internal error: The data type inlist should be same, the value type is Utf8View, one of list expr type is Int32.\n    This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker)", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Wed, 02 Jul 2025 13:08:16 GMT", "content-length": "0"} }
    1: status: Internal, message: "[spiffy-clam], Could not add plan: Other([spiffy-clam], Could not decode plan for query_id 7132cd32-b7ba-4221-b857-5033f21a327f stage 0\n\nCaused by:\n    Internal error: The data type inlist should be same, the value type is Utf8View, one of list expr type is Int32.\n    This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker)", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc", "date": "Wed, 02 Jul 2025 13:08:16 GMT", "content-length": "0"} }) (Internal; ExecuteQuery)

Extra observation for my investigation: p_size column needs our attention here. The TPC-H schema of part define p_size as integer but it seems when we get it back from parquet, it is not always integer. When I replace p-size with p_partkey , the query works

[NGA-TRAN]

This is a DF bug. I have opened a reproducer PR in DF as well as filed a corresponding DF bug ticket

[NGA-TRAN]

I have upgraded DF in #49 to get the fix of apache/datafusion#16665. Close this as done