Create SQLite automatically using sqlite-utils

[rtanglao]

• Create SQLite databases automaticaly using sqlite-utils; Check out Stefan Kühnel''s workflow
  • specifically sqlite-utils insert collection.db collection collection.csv --csv:
  • I think sqlite-utils is better than kludging a pandas dependency for csvs-to-sqlite (which is what i blogged about in October: To get csvs-to-sqlite to work, hardcode pandas dependency to 1.4.0

name: Vercel

on:
  workflow_dispatch:

jobs:
  deployment:
    runs-on: ubuntu-latest
    steps:
      - name: Checkout Repository
        uses: actions/checkout@v3
      - name: Setup Python
        id: python
        uses: actions/setup-python@v4
        with:
          python-version: "3.11"
      - name: Install Dependencies
        run: |
          python -m pip install --upgrade pip
          pip install -r requirements.txt
      - name: Download Excel SpreedSheet
        run: curl -Lo excel.xlsx https://docs.google.com/spreadsheets/d/1by2mZB4-ixVfRAu-_mcRxyQEJGuSfbzPkh-AlrUPCLY/export?format=xlsx
      - name: Download CSV
        run: curl -Lo collection.csv https://docs.google.com/spreadsheets/d/1by2mZB4-ixVfRAu-_mcRxyQEJGuSfbzPkh-AlrUPCLY/export?format=csv
      - name: Create SQLite Database
        run: sqlite-utils insert collection.db collection collection.csv --csv
      - name: Deploy to Vercel
        env:
          VERCEL_TOKEN: ${{ secrets.VERCEL_TOKEN }}
        run: |-
          datasette publish vercel collection.db \
            --branch main \
            --metadata metadata.json \
            --token $VERCEL_TOKEN \
            --project naruto-shippuden-datasette-stefan-dev-de \
            --install datasette-graphql \
            --public
      - name: Delete Previous Release
        continue-on-error: true
        run: gh release delete latest --cleanup-tag --yes
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
      - name: Create Release
        run: |-
          gh release create latest \
            --latest \
            --title "Release" \
            --notes "**Version**: $(date +"%Y%m%d")-git-${GITHUB_SHA:0:7}" \
            "excel.xlsx"
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

[rtanglao]

• Learned about Stefan's awesome workflow via Stefan's commit which referenced error_bad_lines argument has been deprecated simonw/csvs-to-sqlite#88