I want to know, in the future. Do we support full features for pyspark

[peterphung]

I cannot find my answer so I make the discussion here. If someone see the answer somewhere please let me know. Thanks

[cosmicBboy]

Hi @peterphung, thanks for starting the discussion here!

Of course ideally we want to fully support all the features in pyspark, but it's a matter of prioritization and resources. Making this feature complete will need to be community-driven, so thank you for getting the ball rolling here.

To start, what would be your wishlist of things that are most important to you?

[peterphung]

Hi @cosmicBboy, I appreciate your response.

My team wishlist the features:

1. "Groupby checks"
2. "Hypothesis testing"
3. "Dropping inalid rows"

Best regards,