data.md

Data

Datasets that are regularly updated

Part of this project is getting experience with automated data ingestion. Doing so is more interesting with data that changes regularly.

The following are [types of] datasets that could be a good fit:

• Crime
• Transportation
  • Transit
  • Traffic
  • Bike share
    • CitiBike
• Energy
  • The Public Utility Data Liberation (PUDL) Project
  • U.S. Energy Information Administration
• Climate
  • Air quality
    • OpenAQ
  • Atmosphere
    • CarbonMapper
    • MethaneSat
  • Fire
    • NASA FIRMS
      • How to use
  • National Oceanic and Atmospheric Administration
  • NASA Land, Atmosphere Near real-time Capability for Earth observation (LANCE)
  • Surface and ocean temperatures
  • Water quality
  • Weather
• Public facilities
  • Jails/prisons
    • NYC Daily Inmates In Custody
  • Homeless shelters
    • NYC Department of Homeless Services (DHS) Daily Report
• Finance
  • Stocks
  • Indexes
• Polls
  • 538 political polls

Places to find them

• "daily" datasets, via the Socrata Discovery API
• Transportation data:
  • New York City
  • New York State
• NYC's recently updated datasets
  • Could do a similar search in other Socrata portals
• Datasets using git-scraping
  • Background info
• Various open data portals