⚙️ Python File Automation

A browser-based file automation tool built with Python + Flask that lets you upload, rename, convert, organise, and download files — all from a sleek dark-themed web UI. Every automation operation is logged to a PostgreSQL / SQLite database for full task-history tracking.

---

📑 Table of Contents

• Features
• System Architecture
• Use Case Diagram
• Screenshots
• Tech Stack
• Getting Started
• API Reference
• Project Structure

---

✨ Features

Feature	Description
📤 Upload Files	Drag-and-drop or browse to upload one or more files
✏️ Rename Files	Batch-rename uploaded files with a custom prefix (prefix_1.ext, prefix_2.ext, …)
🔄 CSV → JSON	Convert every .csv file into a pretty-printed .json file automatically
📂 Organise Files	Sort files into category sub-folders (images/, documents/, audio/, video/, data/, code/, archives/, others/)
📋 Browse & Download	View uploaded and processed files; download any processed file with one click
🗑️ Clear Folders	Clear the uploads or processed folder independently
🗄️ Task History	Every automation operation is recorded in the database with filename, task type, and status

---

🏗️ System Architecture

flowchart TD
    subgraph Browser["🌐 Browser (Client)"]
        UI["HTML / CSS / JS\nSingle-Page UI"]
    end

    subgraph Flask["🐍 Flask Web Server"]
        direction TB
        R_Index["GET  /"]
        R_Upload["POST /upload"]
        R_Files["GET  /files"]
        R_Rename["POST /rename"]
        R_CSV["POST /csv-to-json"]
        R_Org["POST /organize"]
        R_DL["GET  /download/<file>"]
        R_ClearU["POST /clear-uploads"]
        R_ClearP["POST /clear-processed"]
        R_Tasks["GET  /tasks"]
        R_SeedDB["POST /seed-db"]
    end

    subgraph Automation["⚙️ Automation Modules"]
        M_Rename["rename_files.py\nSequential renaming"]
        M_CSV["csv_to_json.py\nCSV → JSON conversion"]
        M_Sort["sort_files.py\nExtension-based sorting"]
    end

    subgraph FileSystem["💾 File System"]
        FS_Up["uploads/\n(raw input files)"]
        FS_Proc["processed/\n├── images/\n├── documents/\n├── audio/\n├── video/\n├── data/\n├── code/\n├── archives/\n└── others/"]
    end

    subgraph Database["🗄️ Database (SQLAlchemy)"]
        DB[("PostgreSQL / SQLite\nautomation_tasks table\n─────────────────\nid · filename\ntask_type · status\ncreated_at")]
    end

    UI -- "HTTP REST (JSON/multipart)" --> Flask
    R_Upload --> FS_Up
    R_Rename --> M_Rename --> FS_Proc
    R_CSV    --> M_CSV    --> FS_Proc
    R_Org    --> M_Sort   --> FS_Proc
    R_Files  --> FS_Up & FS_Proc
    R_DL     --> FS_Proc
    FS_Up    -. "reads" .-> M_Rename & M_CSV & M_Sort
    R_Tasks  --> Database
    R_SeedDB --> Database
    M_Rename -. "logs task" .-> Database
    M_CSV    -. "logs task" .-> Database
    M_Sort   -. "logs task" .-> Database

Loading

---

🎯 Use Case Diagram

graph LR
    User(("👤 User"))

    User --> UC1["📤 Upload Files\n(drag-and-drop / browse)"]
    User --> UC2["✏️ Rename Files\n(custom prefix)"]
    User --> UC3["🔄 Convert CSV to JSON"]
    User --> UC4["📂 Organise Files by Type"]
    User --> UC5["📋 Browse Files"]
    User --> UC6["⬇️ Download Processed File"]
    User --> UC7["🗑️ Clear Uploads / Processed"]
    User --> UC8["🗄️ View Task History"]

    UC2 -. "requires" .-> UC1
    UC3 -. "requires" .-> UC1
    UC4 -. "requires" .-> UC1
    UC6 -. "requires" .-> UC5
    UC8 -. "reads from" .-> DB[("🗄️ Database")]

    UC2 -. "logs to" .-> DB
    UC3 -. "logs to" .-> DB
    UC4 -. "logs to" .-> DB

    style User fill:#6c63ff,color:#fff,stroke:#6c63ff
    style UC1 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC2 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC3 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC4 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC5 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC6 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC7 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style UC8 fill:#1a1d27,color:#e2e8f0,stroke:#2a2d3e
    style DB  fill:#0f3460,color:#e2e8f0,stroke:#1a6aab

Loading

---

🖼️ Screenshots

1 · Upload Files

Drag-and-drop files into the drop zone or browse your filesystem. A live file preview shows selected files before uploading.

---

2 · Rename Files

Enter a prefix and click Rename Files. Every file in uploads/ is copied to processed/ with the pattern <prefix>_N.ext.

---

3 · CSV → JSON Conversion

Click Convert CSV → JSON to transform all uploaded .csv files into structured, pretty-printed JSON arrays stored in processed/.

---

4 · Organise Files by Type

Click Organise Files to automatically sort every uploaded file into a named sub-folder inside processed/ based on its extension.

---

5 · Browse & Download Files

See both uploads/ and processed/ content at a glance. Download any processed file with one click.

---

🛠️ Tech Stack

Layer	Technology
Backend	Python 3, Flask
Database	PostgreSQL (production) / SQLite (development) via SQLAlchemy ORM
File handling	os, shutil, csv, json (stdlib)
Frontend	Vanilla HTML5, CSS3 (custom dark theme), JavaScript (Fetch API)
Deployment	Vercel (serverless)
Security	werkzeug.utils.secure_filename, path-traversal guard on downloads

🗄️ Database Schema

The automation_tasks table is used to record every file operation. Schema shown in PostgreSQL syntax; for SQLite, replace SERIAL with INTEGER (SQLite auto-increments integer primary keys automatically).

-- PostgreSQL
CREATE TABLE IF NOT EXISTS automation_tasks (
    id         SERIAL PRIMARY KEY,
    filename   VARCHAR(255)  NOT NULL,
    task_type  VARCHAR(50)   NOT NULL,   -- 'rename' | 'csv_to_json' | 'organize'
    status     VARCHAR(20)   NOT NULL,   -- 'processing' | 'completed' | 'failed'
    created_at TIMESTAMP     DEFAULT CURRENT_TIMESTAMP
);

-- SQLite equivalent
CREATE TABLE IF NOT EXISTS automation_tasks (
    id         INTEGER PRIMARY KEY AUTOINCREMENT,
    filename   TEXT          NOT NULL,
    task_type  TEXT          NOT NULL,
    status     TEXT          NOT NULL,
    created_at TIMESTAMP     DEFAULT CURRENT_TIMESTAMP
);

---

🚀 Getting Started

Prerequisites

• Python 3.9+
• pip
• PostgreSQL (optional — SQLite used automatically when DATABASE_URL is not set)

Installation

# 1 · Clone the repository
git clone https://github.com/22MH1A42G1/Python-File-Automation.git
cd Python-File-Automation/file_automation_web

# 2 · Install dependencies
pip install -r requirements.txt

# 3 · (Optional) Set your database URL
#     Skip this step to use SQLite locally; required for PostgreSQL / Vercel
export DATABASE_URL="postgresql://user:password@host:5432/dbname"

# 4 · Create the database table — PostgreSQL only (run once)
#     SQLite users: skip this step; the table is created automatically by SQLAlchemy.
psql $DATABASE_URL -c "
  CREATE TABLE IF NOT EXISTS automation_tasks (
    id         SERIAL PRIMARY KEY,
    filename   VARCHAR(255) NOT NULL,
    task_type  VARCHAR(50)  NOT NULL,
    status     VARCHAR(20)  NOT NULL,
    created_at TIMESTAMP    DEFAULT CURRENT_TIMESTAMP
  );"

# 5 · Run the development server
python app.py

Open your browser at http://127.0.0.1:5000 🎉

Dependencies (requirements.txt)

flask
werkzeug
sqlalchemy
psycopg2-binary

---

📡 API Reference

Method	Endpoint	Description
GET	/	Serve the web UI
POST	/upload	Upload one or more files (multipart form)
GET	/files	List files in uploads/ and processed/
POST	/rename	Rename files — body: {"prefix": "my_prefix"}
POST	/csv-to-json	Convert all CSV files in uploads to JSON
POST	/organize	Organise files into category sub-folders
GET	/download/<path:filename>	Download a processed file
POST	/clear-uploads	Delete all files from uploads/
POST	/clear-processed	Delete all files/folders from processed/
GET	/tasks	Retrieve all automation task records from the database
POST	/seed-db	Insert a demo task record and mark it completed (dev only)

---

📁 Project Structure

Python-File-Automation/
├── README.md
├── requirements.txt
├── vercel.json                  # Vercel serverless deployment config
└── file_automation_web/
    ├── app.py                   # Flask application & route definitions (local dev)
    ├── requirements.txt         # Python dependencies
    ├── api/
    │   └── index.py             # Vercel serverless entry-point (includes DB routes)
    ├── automation/
    │   ├── __init__.py
    │   ├── rename_files.py      # Batch-rename logic
    │   ├── csv_to_json.py       # CSV → JSON conversion logic
    │   └── sort_files.py        # Extension-based file organiser
    ├── static/
    │   ├── style.css            # Dark-theme stylesheet
    │   └── script.js            # Frontend JS (Fetch API interactions)
    └── templates/
        └── index.html           # Single-page application template

---

📂 File Category Mapping

Category	Extensions
🖼️ images	.jpg .jpeg .png .gif .bmp .svg .webp .tiff
📄 documents	.pdf .doc .docx .txt .xls .xlsx .ppt .pptx .odt
🎵 audio	.mp3 .wav .aac .flac .ogg .m4a .wma
🎬 video	.mp4 .avi .mov .mkv .wmv .flv .webm
📊 data	.csv .json .xml .sql .db .sqlite
💻 code	.py .js .ts .html .css .java .cpp .c .go .rb
🗜️ archives	.zip .rar .tar .gz .7z .bz2
❓ others	Everything else

---

🪪 License

This project is open source. Feel free to use, modify, and distribute.