Skip to content

[FLINK] UT failed as BinaryRowData can not be converted to StatefulRecord #10361

@KevinyhZou

Description

@KevinyhZou

Backend

VL (Velox)

Bug description

Run the ut of ScalarFunctionTest , and errors as below

04:18:13.717 [Source: tblSub[35] -> gluten-calc -> Sink: Collect table sink (1/1)#0] WARN  org.apache.flink.runtime.taskmanager.Task  - Source: tblSub[35] -> gluten-calc -> Sink: Collect table sink (1/1)#0 (d3bdecf1ec82b852d58a9ac9db0f10f8_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to FAILED with failure cause:
java.lang.ClassCastException: class org.apache.flink.table.data.binary.BinaryRowData cannot be cast to class io.github.zhztheplayer.velox4j.stateful.StatefulRecord (org.apache.flink.table.data.binary.BinaryRowData and io.github.zhztheplayer.velox4j.stateful.StatefulRecord are in unnamed module of loader 'app')
	at org.apache.gluten.table.runtime.operators.GlutenVectorOneInputOperator.processElement(GlutenVectorOneInputOperator.java:114)
	at org.apache.flink.streaming.runtime.tasks.ChainingOutput.pushToOperator(ChainingOutput.java:109)
	at org.apache.flink.streaming.runtime.tasks.ChainingOutput.collect(ChainingOutput.java:78)
	at org.apache.flink.streaming.runtime.tasks.ChainingOutput.collect(ChainingOutput.java:40)
	at org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollect(StreamSourceContexts.java:425)
	at org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collect(StreamSourceContexts.java:520)
	at org.apache.flink.streaming.api.operators.StreamSourceContexts$SwitchingOnClose.collect(StreamSourceContexts.java:110)
	at org.apache.flink.streaming.api.functions.source.FromElementsFunction.run(FromElementsFunction.java:237)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:113)
	at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:71)
	at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:338)

Gluten version

No response

Spark version

None

Spark configurations

No response

System information

No response

Relevant logs

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtriage

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions