Snowflake Dialect and Testing (#363)

Author: hadia206

.github/workflows/pr_testing.yml

@@ -16,6 +16,11 @@ on:
         description: "Python 3.12"
         type: boolean
         default: true
+      run-all:
+        description: "Run All Tests"
+        type: boolean
+        required: false
+        default: false
       run-python:
         description: "Run Main PyDough Tests"
         type: boolean
@@ -101,8 +106,9 @@ jobs:
     # https://docs.github.com/en/actions/learn-github-actions/expressions#contains
     # contains is case-insensitive
     if: |
+      (github.event_name == 'pull_request' && contains(needs.get-msg.outputs.commitMsg, '[run all]')) ||
       (github.event_name == 'pull_request' && contains(needs.get-msg.outputs.commitMsg, '[run ci]')) ||
-      (github.event_name == 'workflow_dispatch' && inputs.run-python)
+      (github.event_name == 'workflow_dispatch' && (inputs.run-all || inputs.run-python))
     runs-on: ubuntu-latest
     strategy:
       matrix:
@@ -138,8 +144,9 @@ jobs:
     name: Snowflake Tests
     needs: [get-msg, get-py-ver-matrix]
     if: |
+      (github.event_name == 'pull_request' && contains(needs.get-msg.outputs.commitMsg, '[run all]')) ||
       (github.event_name == 'pull_request' && contains(needs.get-msg.outputs.commitMsg, '[run sf]')) ||
-      (github.event_name == 'workflow_dispatch' && inputs.run-sf)
+      (github.event_name == 'workflow_dispatch' && (inputs.run-all || inputs.run-sf))
     uses: ./.github/workflows/sf_testing.yml
     secrets:
       SF_USERNAME: ${{ secrets.SF_USERNAME }}
@@ -154,8 +161,9 @@ jobs:
     name: MySQL Tests
     needs: [get-msg, get-py-ver-matrix]
     if: |
+      (github.event_name == 'pull_request' && contains(needs.get-msg.outputs.commitMsg, '[run all]')) ||
       (github.event_name == 'pull_request' && contains(needs.get-msg.outputs.commitMsg, '[run mysql]')) ||
-      (github.event_name == 'workflow_dispatch' && inputs.run-mysql)
+      (github.event_name == 'workflow_dispatch' && (inputs.run-all || inputs.run-mysql))
     uses: ./.github/workflows/mysql_testing.yml # Path to MySQL workflow file
     secrets:
       MYSQL_USERNAME: ${{ secrets.MYSQL_USERNAME }}

README.md

@@ -97,8 +97,49 @@ script must be run so that the `defog.db` file is located in the `tests` directo
 
 ## Running CI Tests
 
-To run our CI tests on your PR, you must include the flag `[run CI]` in latest
-commit message.
+When submitting a PR, you can control which CI tests run by adding special flags
+to your **latest commit message**.
+
+**Note:** All flags are **case-insensitive**.
+
+- To run **PyDough CI tests**, add: `[run CI]` (only runs **SQLite tests**, no other SQL dialects)  
+- To run **PyDough and all dialect tests**, add: `[run all]`  
+- To run **specific dialect tests**, use the corresponding flag as described below.
+
+### Running Snowflake Tests on CI
+To run **Snowflake CI tests**, add the flag `[run SF]` to your commit message.
+
+**Running Snowflake tests locally:**
+
+1. Install the Snowflake Connector for Python with Pandas support
+    ```bash
+    pip install "snowflake-connector-python[pandas]"
+    ```
+
+2. Set your Snowflake credentials as environment variables:
+    ```bash
+        export SF_USERNAME="your_username"
+        export SF_PASSWORD="your_password"
+        export SF_ACCOUNT="your_account"
+    ```
+
+### Running MySQL Tests on CI
+To run **MySQL CI tests**, add the flag `[run mysql]` to your commit message.
+
+**Running MySQL tests locally:**
+
+1. Make sure you have [**Docker Desktop**](https://www.docker.com/get-started/)
+ installed and running.
+
+2. Install the MySQL Connector for Python
+    ```bash
+    pip install mysql-connector-python
+    ```
+
+3. Set your MySQL credentials as environment variables:
+    ```bash
+        export MYSQL_USERNAME="your_username"
+        export MYSQL_PASSWORD="your_password"
 
 ## Runtime Dependencies
 

demos/README.md

@@ -24,4 +24,5 @@ Once the introduction notebook is complete, you can explore the other notebooks:
 - [4_tpch.ipynb](notebooks/4_tpch.ipynb) provides PyDough translations for most of the TPC-H benchmark queries.
 - [5_what_if.ipynb](notebooks/5_what_if.ipynb) demonstrates how to do WHAT-IF analysis with PyDough.
 - [MySQL_TPCH.ipynb](notebooks/MySQL_TPCH.ipynb) demonstrates how to connect a MySQL database with PyDough.
+- [SF_TPCH_q1.ipynb](notebooks/SF_TPCH_q1.ipynb) demonstrates how to connect a Snowflake database with PyDough.
 

demos/notebooks/1_introduction.ipynb

@@ -294,7 +294,7 @@
    "name": "python",
    "nbconvert_exporter": "python",
    "pygments_lexer": "ipython3",
-   "version": "3.13.5"
+   "version": "3.12.2"
   }
  },
  "nbformat": 4,

demos/notebooks/MySQL_TPCH.ipynb

@@ -28,7 +28,7 @@
     "> You can also test with our **pre-built MySQL TPC-H database** available on **Docker Hub**.\n",
     ">\n",
     "> #### 📋 Requirements\n",
-    "> - Make sure you have **Docker** installed.\n",
+    "> - Make sure you have **Docker Desktop** installed and running.\n",
     ">\n",
     "> #### 📦 Pull and Run the Container\n",
     "> ```bash\n",