pyarrow version #2
Description
The file setup.py doesn't include versioning information for packages and I couldn't find a compatible version of pyarrow.
Using the latest versions of pyarrow results in errors that look like;
Traceback (most recent call last):
File "/Users/.../schema_from_parquet/cell_imager_schema.py", line 13, in <module>
status = parquet_to_athena(file_path, location, database, table, partition, create_table, workgroup, reqion)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/.../schema_from_parquet/parquet_to_athena/parquet_to_athena.py", line 63, in parquet_to_athena
physical_col_type = dataframe.schema[col].physical_type
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'pyarrow.lib.Field' object has no attribute 'physical_type'