Skip to content

yangmarc/web-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

web-crawler

Web-crawler

Execute the following command

Clean and Build

mvn clean && mvn package

Run the program

java -cp target/webcrawler-1.0-SNAPSHOT.jar com.webcrawler.app.App [ domain ] [ start Url ] [ maxThreads ] [ maxDepth ]

Example

java -cp target/webcrawler-1.0-SNAPSHOT.jar com.webcrawler.app.App https://www.example.com https://www.example.com/ 5 2

Default:

maxThreads = 5
maxDepth = 2

About

Web-crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages