Skip to content

Neidz/yoink

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Usage: yoink [OPTIONS] --url <URL>

Options:
      --url <URL>
      --depth-limit <DEPTH_LIMIT>                [default: 100]
      --concurrency-limit <CONCURRENCY_LIMIT>    [default: 100]
      --request-timeout-ms <REQUEST_TIMEOUT_MS>  [default: 1000]
      --min-interval-ms <MIN_INTERVAL_MS>        [default: 100]
      --user-agent <USER_AGENT>                  [default: Mozilla/5.0]
      --output-directory <OUTPUT_DIRECTORY>      [default: scraper_output]
      --verbose

About

Web crawler for traversing entire website and saving it's html

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages