MIT Libraries Spidergram Crawl

Configuration files and supporting code for Autogram's crawl/analysis of MIT Libraries' staff intranet.

Setup

• npm install to splat in the dependencies, including Spidergram itself.
• Fire up ArangoDB in a local Docker container, or use a .env file with ARANGO_URL, ARANGO_USER, ARANGO_PASS, and ARANGO_DB values to point it at an existing instance.

Usage

• When run from inside this project, the spidergram CLI command should be usable in scripts. npm run report and npm run crawl are already set up in package.json.