v0.9.59

Added

• Nothing

Changed

• install-chrome.sh was failing - error message suggested it needs
  an apt-get update -y before apt-get install so added the
  update
• dev-env 0.6.19 -> 0.6.21
• change generate-circleci-config.py to start
  using CircleCI Scheduled Pipelines

Removed

• Nothing

v0.9.58

Added

• added resource_class: medium to the CircleCI config
  generated by generate-circleci-config.py

Changed

• dev-env 0.6.17 -> 0.6.19

Removed

• Nothing

v0.9.57

Added

• added sample spider alpine_releases.py
• added --pretty command line option to run-sample.sh
• simple approach to skipping CircleCI build, test and deploy of
  runtime and runtime lite docker images - very useful during
  development when upgrading major things like Python and/or OS
  versions
• added explicit resource class
  to CircleCI config

Changed

• dev-env 0.6.13 -> 0.6.17
• python-dateutil 2.8.1 -> 2.8.2
• selenium 3.141.0 -> 4.1.0
• bin/install-chromedriver.sh was failing for newer versions of chromium because
  the format returned by "chromium-browser --version" changed - fix this problem
• for runtime lite Alphe base image 3.12 -> 3.15
• refined bin/install-chromedriver.sh output when installing on Alpine
• simonsdave/bionic-dev-env:v0.6.14 -> simonsdave/focal-dev-env:v0.6.16
• fixed install-chrome.sh usage message
• added 2022 to License

Removed

• removed LGTM workflows and badges in main README.md

v0.9.56

Added

• Nothing

Changed

• fixed how generate-circleci-config.py uses/calls int-test-run-all-spiders-in-ci-pipeline.py

Removed

• Nothing

v0.9.55

Added

• Nothing

Changed

• fixed a silly bug in int-test-run-all-spiders-in-ci-pipeline.py and how
  it made the command unusable - also put in real python logging for this command
  and real command line option handling

Removed

• Nothing

v0.9.54

Added

• Nothing

Changed

• update generate-circleci-config.py to eliminate the need for requirements.txt
  in spider repos
• runtime docker images no longer samples init.py as executable

Removed

• Nothing

v0.9.53

Added

• added optional --samples command line option to spiders.py
• added optional samples argument to SpiderDiscovery() constructor
• added categories to spider metadata - if no categories are specified
  then the name of the package containing the spider is assumed to be the
  category name - only place that categories are current used is in the API
  as a means to group spiders
• added absoluteFilename property to spider metadata - this value is
  generated by Cloudfeaster
• added fullyQualifiedClassName property to spider metadata - this value is
  generated by Cloudfeaster

Changed

• docker based development environment now parses repo's setup.py for pre-reqs
  that need to be install when the development docker image is built - this
  change enabled the removal of requirements.txt from the repo's root directory
• change format of metadata returned by spiders.py and cloudfeaster.spider.Spider

Removed

• Nothing

v0.9.52

Added

• Circle CI pipeline now saves generated python distributions as Circle CI artifacts
• added int-test-run-all-spiders-in-ci-pipeline.py which is intended for use
  in spider repo CI pipelines

Changed

• Nothing

Removed

• Nothing

v0.9.51

Added

• use update-alternatives in runtime docker image so python "points to" python3.7

Changed

• cloudfeaster-lite docker image is now based on Alpine 3.12 (used to be Alpine 3.8)

• install-chrome.sh now able to install both Chrome
  and Chromium based on command line switches

• install-chromedriver.sh determines which version of chromedriver to install based
  on which version of Chrome or Chromium
  is installed - see this
  for a complete description of the version selection process

• default Chrome command line options are now

  • --headless
  • --window-size=1280x1024
  • --no-sandbox
  • --disable-dev-shm-usage
  • --disable-gpu
  • --disable-software-rasterizer
  • --single-process
  • --user-agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36

Removed

• Nothing

v0.9.50

Added

• Nothing

Changed

• install-dev-env-scripts.sh now requires virtual env
• dev-env v0.6.12 -> v0.6.13

Removed

• Nothing