-
-
Notifications
You must be signed in to change notification settings - Fork 19.1k
Closed
Labels
Arrowpyarrow functionalitypyarrow functionalityBugMissing-datanp.nan, pd.NaT, pd.NA, dropna, isnull, interpolatenp.nan, pd.NaT, pd.NA, dropna, isnull, interpolate
Description
Pandas version checks
-
I have checked that this issue has not already been reported.
-
I have confirmed this bug exists on the latest version of pandas.
-
I have confirmed this bug exists on the main branch of pandas.
Reproducible Example
### Describe the bug, including details regarding any error messages, version, and platform.
when pandas has a null column,compare will get a False,
import duckdb as dd
df=dd.sql("select null as id").df()
df['id']>1
0 False
Name: id, dtype: bool
but change to arrow, will get NA, how to get False?
import pyarrow as pa
import pandas as pd
df2=pa.Table.from_pandas(df).to_pandas(types_mapper=pd.ArrowDtype,use_threads=True)
df2['id']>1
0 <NA>
Name: id, dtype: bool[pyarrow]
### Component(s)
Python
Issue Description
pandas2.2.3,use arrow backend,
got NA,need False,
how to got same result?
Expected Behavior
df['id']>1,want return False
Installed Versions
pandas2.2.3
Metadata
Metadata
Assignees
Labels
Arrowpyarrow functionalitypyarrow functionalityBugMissing-datanp.nan, pd.NaT, pd.NA, dropna, isnull, interpolatenp.nan, pd.NaT, pd.NA, dropna, isnull, interpolate