Merge pull request #795 from sfu-db/refactor/optimize-pd-reconstruction

refactor: Optimize DataFrame Reconstruction & Update Docs for Linux ARM64 Release

fix #786

Author: wangxiaoying

README.md

@@ -48,6 +48,8 @@ Check out more detailed usage and examples [here](https://sfu-db.github.io/conne
 pip install connectorx
 ```
 
+_For AArch64 or ARM64 Linux users, `connectorx==0.4.3 & above` is only available for distributions using `glibc 2.35` and above. Specifically, the re-release for this architecture was tested on Ubuntu 22.04. For older distributions, the latest version available is `connectorx==0.2.3` due to dependency limitations._
+
 Check out [here](https://sfu-db.github.io/connector-x/install.html#build-from-source-code) to see how to build python wheel from source.
 
 # Performance

connectorx-python/connectorx/__init__.py

@@ -475,7 +475,7 @@ def reconstruct_pandas(df_infos: _DataframeInfos) -> pd.DataFrame:
         elif binfo.dt == 3:  # DatetimeArray
             blocks.append(
                 pd.core.internals.make_block(
-                    pd.core.arrays.DatetimeArray(block_data), placement=binfo.cids
+                    pd.core.arrays.DatetimeArray._from_sequence(block_data), placement=binfo.cids
                 )
             )
         else:
@@ -484,7 +484,7 @@ def reconstruct_pandas(df_infos: _DataframeInfos) -> pd.DataFrame:
     block_manager = pd.core.internals.BlockManager(
         blocks, [pd.Index(headers), pd.RangeIndex(start=0, stop=nrows, step=1)]
     )
-    df = pd.DataFrame(block_manager)
+    df = pd.DataFrame._from_mgr(block_manager, axes=[headers, range(nrows)])
     return df
 
 

docs/install.md

@@ -10,6 +10,10 @@ The easiest way to install ConnectorX is using pip, with the following command:
 pip install connectorx
 ```
 
+```{note}
+For AArch64 or ARM64 Linux users, `connectorx==0.4.3 & above` is only available for distributions using `glibc 2.35` and above. Specifically, the re-release for this architecture was tested on Ubuntu 22.04. For older distributions, the latest version available is `connectorx==0.2.3` due to dependency limitations.
+```
+
 ### Build from source code
 
 * Step 0: Install tools.