Usage: yoink [OPTIONS] --url <URL>
Options:
--url <URL>
--depth-limit <DEPTH_LIMIT> [default: 100]
--concurrency-limit <CONCURRENCY_LIMIT> [default: 100]
--request-timeout-ms <REQUEST_TIMEOUT_MS> [default: 1000]
--min-interval-ms <MIN_INTERVAL_MS> [default: 100]
--user-agent <USER_AGENT> [default: Mozilla/5.0]
--output-directory <OUTPUT_DIRECTORY> [default: scraper_output]
--verbose-
Notifications
You must be signed in to change notification settings - Fork 0
Neidz/yoink
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Web crawler for traversing entire website and saving it's html
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published