Skip to content

Conversation

@KevinyhZou
Copy link

@KevinyhZou KevinyhZou commented Jun 4, 2025

在过去的实现中, 执行gluten flink 任务, task的运行时通过operator 在执行processElement的时候,逐条的调用jni 通过velox 的task执行来获取结果,性能较差。

此处通过替换该逻辑,通过velox 中C++的单线程的循环代替jni调用,减少性能损失。

@KevinyhZou KevinyhZou changed the title [Feature][Flink]Support task run not by jni call but use velox loop [Flink][Feature]Support task run not by jni call but use velox loop Jun 4, 2025
@xinghuayu007 xinghuayu007 mentioned this pull request Oct 28, 2025
RowVectorPtr StatefulTask::next(int32_t& retCode) {
retCode = 0;
initOperators();
// initOperators();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个注释的原因是?

} else {
break;
// break;
return nullptr;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里直接return?

Copy link
Member

@zhanglistar zhanglistar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

不是很理解这个修改

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants