Skip to content

BUG: arrow backend get wrong result #60770

@wonb168

Description

@wonb168

Pandas version checks

  • I have checked that this issue has not already been reported.

  • I have confirmed this bug exists on the latest version of pandas.

  • I have confirmed this bug exists on the main branch of pandas.

Reproducible Example

### Describe the bug, including details regarding any error messages, version, and platform.

when pandas has a null columncompare will get a Falseimport duckdb as dd
df=dd.sql("select null as id").df()
df['id']>1

0    False
Name: id, dtype: bool

but change to arrow, will get NA, how to get False?

import pyarrow as pa
import pandas as pd
df2=pa.Table.from_pandas(df).to_pandas(types_mapper=pd.ArrowDtype,use_threads=True)
df2['id']>1

0    <NA>
Name: id, dtype: bool[pyarrow]

### Component(s)

Python

Issue Description

pandas2.2.3,use arrow backend,
got NA,need False,
how to got same result?

Expected Behavior

df['id']>1,want return False

Installed Versions

pandas2.2.3

Metadata

Metadata

Assignees

No one assigned

    Labels

    Arrowpyarrow functionalityBugMissing-datanp.nan, pd.NaT, pd.NA, dropna, isnull, interpolate

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions