Archives Tamil Nadu Government Gazettes (Ordinary & Extraordinary) from the Stationery and Printing Department website. Produces CSV and Parquet datasets published to FlatGitHub and archived to the Internet Archive via Wayback Machine.
Both CSV and Parquet files are generated:
| Format | Size (2025) | Use case |
|---|---|---|
| CSV | 179 MB | Human-readable, editable in any spreadsheet or text editor |
| Parquet | 42 MB | Machine-friendly, fast analytical queries, type-preserving |
Parquet compresses ~4× smaller than CSV and preserves column types (dates, integers) — ideal for programmatic analysis with pandas, DuckDB, or any Parquet-compatible tool.
# Install dependencies
pip install -r requirements.txt
# Quick scrape — Extraordinary Gazettes only (2024–2026)
python scrape_gazettes.py
# Full archive — Ordinary + Extraordinary + Wayback archival
python tn_gazette_archiver.py [--archive-mode full|current-year]Lightweight single-pass scraper for Extraordinary Gazettes. Currently configured for 2024–2026. Saves CSV + Parquet to data/.
Full archiver that:
- Scrapes both Ordinary and Extraordinary Gazettes
- Runs Wayback Machine archival on PDF links
- Supports
current-year(default) andfull(2008–2026) modes
Files are saved to data/:
ExtraOrdinaryGazattes_{year}.csv/.parquet— Extraordinary gazette entriesGazattes_{year}.csv/.parquet— Ordinary gazette entriesGazatteIssues_{year}.csv/.parquet— Ordinary gazette issue listing
| Column | Description |
|---|---|
| Issue No | Gazette issue number |
| Issue Date | Publication date |
| Extraordinary Part & Section | Section identifier (PDF link embedded) |
| PDF Link | Direct URL to the PDF |
| Extraordinary Type | Category description |
| Subject | Full subject text |
| Department | Issuing department |
| G.O No | Government Order reference number |
MIT