Merge remote-tracking branch 'upstream/main' into read-csv-from-directory

Author: fangchenli

web/pandas/about/roadmap.md

@@ -58,27 +58,6 @@ library, making their behavior more consistent with the handling of
 NumPy arrays. We'll do this by cleaning up pandas' internals and
 adding new methods to the extension array interface.
 
-### String data type
-
-Currently, pandas stores text data in an `object` -dtype NumPy array.
-The current implementation has two primary drawbacks: First, `object`
--dtype is not specific to strings: any Python object can be stored in an
-`object` -dtype array, not just strings. Second: this is not efficient.
-The NumPy memory model isn't especially well-suited to variable width
-text data.
-
-To solve the first issue, we propose a new extension type for string
-data. This will initially be opt-in, with users explicitly requesting
-`dtype="string"`. The array backing this string dtype may initially be
-the current implementation: an `object` -dtype NumPy array of Python
-strings.
-
-To solve the second issue (performance), we'll explore alternative
-in-memory array libraries (for example, Apache Arrow). As part of the
-work, we may need to implement certain operations expected by pandas
-users (for example the algorithm used in, `Series.str.upper`). That work
-may be done outside of pandas.
-
 ### Apache Arrow interoperability
 
 [Apache Arrow](https://arrow.apache.org) is a cross-language development

web/pandas/static/css/pandas.css

@@ -106,23 +106,22 @@ blockquote {
     color: #787878;
     font-size: 18px;
  }
-
 .toc {
-    background: #f0f0f0;
-    padding: 10px;
+    background: #f9f9f9;
+    padding: 1em;
+    border: 0.1em solid darkgrey;
+    border-radius: 0.4em;
     display: inline-block;
+    margin: 1em 0;
+}
+.toc .toctitle {
+    font-weight: bold;
+    padding-bottom: 1em;
 }
 a.headerlink {
     opacity: 0;
 }
-h2:hover a.headerlink {
-    opacity: 1;
-    transition: opacity 0.5s;
-}
-h3:hover a.headerlink {
+h2:hover a.headerlink, h3:hover a.headerlink {
     opacity: 1;
     transition: opacity 0.5s;
 }
-.container {
-    max-width: 100ch;
-}

web/pandas_web.py

@@ -441,6 +441,16 @@ def main(
     For ``.md`` and ``.html`` files, render them with the context
     before copying them. ``.md`` files are transformed to HTML.
     """
+    # Sanity check: validate that versions.json is valid JSON
+    versions_path = os.path.join(source_path, "versions.json")
+    with open(versions_path, encoding="utf-8") as f:
+        try:
+            json.load(f)
+        except json.JSONDecodeError as e:
+            raise RuntimeError(
+                f"Invalid versions.json: {e}. Ensure it is valid JSON."
+            ) from e
+
     config_fname = os.path.join(source_path, "config.yml")
 
     shutil.rmtree(target_path, ignore_errors=True)