Skip to content

Commit 7f4fce4

Browse files
HyukjinKwongatorsmile
authored andcommitted
[SPARK-25179][PYTHON][DOCS] Document BinaryType support in Arrow conversion
## What changes were proposed in this pull request? This PR targets to document binary type in "Apache Arrow in Spark". ## How was this patch tested? Manually built the documentation and checked. Closes apache#22871 from HyukjinKwon/SPARK-25179. Authored-by: hyukjinkwon <[email protected]> Signed-off-by: gatorsmile <[email protected]> (cherry picked from commit fbaf150) Signed-off-by: gatorsmile <[email protected]>
1 parent b6ba0dd commit 7f4fce4

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

docs/sql-pyspark-pandas-with-arrow.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -127,8 +127,9 @@ For detailed usage, please see [`pyspark.sql.functions.pandas_udf`](api/python/p
127127

128128
### Supported SQL Types
129129

130-
Currently, all Spark SQL data types are supported by Arrow-based conversion except `BinaryType`, `MapType`,
131-
`ArrayType` of `TimestampType`, and nested `StructType`.
130+
Currently, all Spark SQL data types are supported by Arrow-based conversion except `MapType`,
131+
`ArrayType` of `TimestampType`, and nested `StructType`. `BinaryType` is supported only when
132+
installed PyArrow is equal to or higher then 0.10.0.
132133

133134
### Setting Arrow Batch Size
134135

0 commit comments

Comments
 (0)