Drop/filter out rows containing nulls
at the schema level
#17034
Unanswered
90degs2infty
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello everyone!
Is there a way to
DataFrame
containingnull
s in a set of selected columns while at the same timeDataFrame
's schema about the fact that the set of selected columns cannot contain physicalnull
s afterwards? I.e. I'd likeis_nullable
to returnfalse
for the respectiveField
s after dropping (similar to whatfill_null
does).One can easily achieve 1. by passing a suitable
Expr
tofilter
. However, I don't know how to implement 2. Any thoughts? Thank you very much! 🙏Beta Was this translation helpful? Give feedback.
All reactions