Scrapers

Setup

All of the scrapers used in this repository uses the selenium with python and the chromedriver to scrape data from the websites. The extracted data is thn stored in either csv files or in a mysql database. The following are required to run these locally:

1. Python

2. Google Chrome

3. Chromedriver

Make sure the version of chrome and chromedriver are in sync.

The selenium package can be installed by typing pip3 install selenium after installing python.

Website's list

The following is the list of websites whose scraper can be found in this repository:

• Amazon.com (Coupons)

• Amazon.com (Top Deals)

• Amazon.com (Best Seller's)

• Amazon.com (ISBN's) & Amazon.fr (ISBN's)

• amhonline.amh.net.au (Medicine's data)

• Aquaforestaquarium.com (Fishing appliances)

• Bedetheque.com (Comic books)

• boe.es (Education data)

• Namebio.com (Domain data)

• Comicbookdb.com (Comic books)

• healthatlas.gov.gr (Doctor data)

• Marinedepot.com (Fishing appliances)

• Midtowncomics.com (Comic books)

• PSX.com (Stock's data)

• thegreyhoundrecorder.com.au (Dog race data)

End!