Skip to content

Conversation

@juripetersen
Copy link
Contributor

The python join operator's key extraction didn't work properly due to incorrect input handling.
This resulted in a cartesian product, as both keys were null.

@juripetersen juripetersen self-assigned this Mar 31, 2025
@juripetersen juripetersen requested a review from zkaoudi March 31, 2025 12:44
Copy link
Contributor

@zkaoudi zkaoudi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you check with the SparkIntegrationIT.testKMeans test fails?

@juripetersen
Copy link
Contributor Author

Can you check with the SparkIntegrationIT.testKMeans test fails?

This test failed for the previous pull requests as well. It's likely an issue introduced in the 1.0.1 version and has nothing to do with this PR.

@zkaoudi
Copy link
Contributor

zkaoudi commented Mar 31, 2025

@joker-star-l Maybe you can also help as it's the sparkML that fails for some reason..

@joker-star-l
Copy link
Contributor

joker-star-l commented Apr 1, 2025

@joker-star-l Maybe you can also help as it's the sparkML that fails for some reason..

image

This is caused by dependency conflicts.

sparkml 3.1.2 is not work with janino 3.1.8.
I am not sure which version we need to use.

@zkaoudi
Copy link
Contributor

zkaoudi commented Apr 1, 2025

Thank you Mingxi, indeed it was a dependency issue.

@zkaoudi zkaoudi merged commit 44c1b1d into apache:main Apr 1, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants