Skip to content

kyeager4/WebCommittee

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 

Repository files navigation

WebCommittee

Scraping and downloading

sitemap2dataframe.R - Reads the library's sitemap (which is a Drupal XML sitemap) into R as a dataframe

download_megamenu_urls.R - Scrapes the links from the library's megamenu and transforms them into absolute URLs; resulting list of URLs works nicely with wget for automated downloading

About

Basic scraping scripts used for Web Committee projects

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages