Merge pull request #1 from stride-nyc/initial-buildout

Initial buildout

Author: kenjudy

.bandit

@@ -0,0 +1,13 @@
+# Bandit Security Scanner Configuration
+# https://bandit.readthedocs.io/en/latest/config.html
+
+[bandit]
+# Exclude directories
+exclude_dirs = ['.venv', '.pytest_cache', '__pycache__']
+
+# Skip B101 (assert_used) check for test files
+# Asserts are acceptable and expected in test files
+skips = B101
+
+# Only scan specific file patterns
+# (using exclude_dirs above handles most cases)

.env.example

@@ -0,0 +1,15 @@
+# LangSmith Data Export - Environment Variables
+# Copy this file to .env and fill in your actual values
+
+# LangSmith API Key (required)
+# Get your API key from: https://smith.langchain.com/settings
+LANGSMITH_API_KEY=lsv2_pt_your_api_key_here
+
+# LangSmith API URL (optional, uses default if not specified)
+LANGSMITH_API_URL=https://api.smith.langchain.com
+
+# Default project name (optional)
+LANGSMITH_PROJECT=your-project-name
+
+# Default trace limit (optional)
+LANGSMITH_LIMIT=150

.github/WORKFLOWS.md

@@ -0,0 +1,201 @@
+# GitHub Actions CI/CD
+
+This directory contains GitHub Actions workflows for continuous integration and code quality checks.
+
+## Workflows
+
+### 🧪 test.yml - Test Suite
+**Trigger:** Push to any branch (Python changes only), PRs to main (Python changes only)
+
+**What it does:**
+- Matrix testing on Python 3.11 and 3.12
+- Runs pytest with coverage
+- Uploads coverage to Codecov (Python 3.11 only)
+
+**Required:** ✅ Must pass for PR merge
+
+---
+
+### 🎨 lint.yml - Code Quality
+**Trigger:** Push to any branch (Python changes only), PRs to main (Python changes only)
+
+**What it does:**
+- **Ruff**: Fast Python linter (checks imports, unused variables, etc.)
+- **Black**: Code formatting verification (100 char line length)
+- **mypy**: Static type checking
+
+**Required:** ⚠️ Non-blocking but should be addressed
+
+**Fix issues:**
+```bash
+# Auto-fix formatting
+black .
+
+# Auto-fix some linting issues
+ruff check --fix .
+
+# Check types
+mypy . --ignore-missing-imports
+```
+
+---
+
+### 🔒 security.yml - Security Scanning
+**Trigger:** Push to main (Python changes only), PRs (Python changes only), Weekly (Sundays)
+
+**What it does:**
+- **Bandit**: Scans for common security issues
+- **Safety**: Checks for vulnerable dependencies
+- Uploads security reports as artifacts
+
+**Required:** ⚠️ Review findings, critical issues must be fixed
+
+---
+
+### 📊 pr-metrics.yml - PR Analysis
+**Trigger:** PR opened/updated
+
+**What it does:**
+- Analyzes PR size (small/medium/large/extra-large) for Python code
+- Calculates test-to-production code ratio
+- Measures commit quality:
+  - Large commits (>100 lines): Target <20%
+  - Sprawling commits (>5 files): Target <10%
+- Posts analysis comment on PR
+
+**Based on:** [PDCA Framework](https://github.com/kenjudy/human-ai-collaboration-process)
+
+---
+
+## Configuration Files
+
+Configuration can be added to `pyproject.toml` for:
+- **Black** (formatter)
+- **Ruff** (linter)
+- **mypy** (type checker)
+- **pytest** (test runner)
+- **coverage** (coverage reporting)
+- **Bandit** (security scanner)
+
+---
+
+## Local Development
+
+### Run all quality checks locally:
+
+```bash
+# Activate virtual environment
+source .venv/bin/activate  # On Windows: .venv\Scripts\activate
+
+# Run tests with coverage
+pytest . --cov=. --cov-report=term-missing
+
+# Check formatting
+black --check .
+
+# Auto-format code
+black .
+
+# Lint code
+ruff check .
+
+# Auto-fix linting issues
+ruff check --fix .
+
+# Type check
+mypy . --ignore-missing-imports
+
+# Security scan
+bandit -r . --exclude ./.venv,./.pytest_cache
+safety check
+```
+
+### Pre-commit checks:
+
+Before committing, run:
+```bash
+black . && ruff check --fix . && pytest .
+```
+
+---
+
+## Quality Targets
+
+### Test Coverage
+- **Target:** >80%
+- **Location:** All Python files
+
+### Commit Quality
+- **Large commits:** <20% (>100 production lines)
+- **Sprawling commits:** <10% (>5 files changed)
+- **Test ratio:** 0.5-2.0 (test lines : production lines)
+
+### PR Size
+- **Small:** <100 production lines
+- **Medium:** 100-200 lines
+- **Large:** 200-500 lines (harder to review)
+- **Extra-large:** >500 lines (should be split)
+
+### Code Quality
+- **Complexity:** Max 10 (ruff C901)
+- **Line length:** 100 characters (black)
+- **Import organization:** Automatic (ruff I)
+
+---
+
+## Troubleshooting
+
+### CI failures
+
+**Tests failing:**
+```bash
+# Run locally with same environment
+LANGSMITH_API_KEY=test-api-key pytest . -v
+```
+
+**Coverage too low:**
+- Add tests for untested code
+- Check coverage report: `pytest --cov=. --cov-report=html`
+- Open `htmlcov/index.html` in browser
+
+**Linting failures:**
+```bash
+# See what needs fixing
+ruff check .
+
+# Auto-fix
+ruff check --fix .
+black .
+```
+
+**Security issues:**
+```bash
+# See details
+bandit -r . --exclude ./.venv,./.pytest_cache -f screen
+safety check
+
+# Review and fix critical issues
+# Update dependencies if needed
+```
+
+---
+
+## Badges
+
+Add to README.md:
+
+```markdown
+![Tests](https://github.com/YOUR_USERNAME/export-langsmith-data/workflows/Tests/badge.svg)
+![Lint](https://github.com/YOUR_USERNAME/export-langsmith-data/workflows/Lint/badge.svg)
+![Security](https://github.com/YOUR_USERNAME/export-langsmith-data/workflows/Security/badge.svg)
+[![codecov](https://codecov.io/gh/YOUR_USERNAME/export-langsmith-data/branch/main/graph/badge.svg)](https://codecov.io/gh/YOUR_USERNAME/export-langsmith-data)
+```
+
+---
+
+## References
+
+- [PDCA Framework for AI-Assisted Code Generation](https://github.com/kenjudy/human-ai-collaboration-process)
+- [Ruff Documentation](https://docs.astral.sh/ruff/)
+- [Black Documentation](https://black.readthedocs.io/)
+- [pytest Documentation](https://docs.pytest.org/)

.github/workflows/lint.yml

@@ -0,0 +1,56 @@
+name: Lint
+
+on:
+  push:
+    branches: ["**"]
+    paths:
+      - '**.py'
+      - 'requirements.txt'
+      - '.github/workflows/lint.yml'
+  pull_request:
+    branches: [main]
+    paths:
+      - '**.py'
+      - 'requirements.txt'
+      - '.github/workflows/lint.yml'
+
+jobs:
+  lint:
+    name: Code Quality Checks
+    runs-on: ubuntu-latest
+
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Set up Python 3.11
+        uses: actions/setup-python@v5
+        with:
+          python-version: "3.11"
+          cache: 'pip'
+
+      - name: Install dependencies
+        run: |
+          python -m pip install --upgrade pip
+          pip install ruff mypy black
+          pip install -r requirements.txt
+
+      - name: Run Ruff (linting)
+        run: |
+          ruff check . --output-format=github
+        continue-on-error: true
+
+      - name: Run Black (formatting check)
+        run: |
+          black --check .
+        continue-on-error: true
+
+      - name: Run mypy (type checking)
+        run: |
+          mypy . --ignore-missing-imports --no-strict-optional
+        continue-on-error: true
+
+      - name: Summary
+        if: always()
+        run: |
+          echo "✅ Lint checks complete. Review warnings above."
+          echo "Note: Failures are non-blocking but should be addressed."