CNNWebScrapper

Scrapes list of URLs from CNN.com and forms a TF-IDF matrix

Steps to execute:

Generate data matrix:

Enter list of website URLs in website_list(make sure there are no blank lines in the file)

Precondition: Install Beautifulsoup, nltk precondition: should be executed in python2 environment

Executeion

python2 URLScrappedToken.py

postresults: data.csv is generated, which contains list of articles and word frequency matrix.