Wild Spider
web pages are crawled by being loaded into browser using multiple tabs parallelly
What is Wild Spider?
Stats
Other platforms
Summary
WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).
The "spider" works in this way:
- The current url is used as the starting point, and it's loaded again in a new tab.
- After this page is loaded, fetch all the links on the page.
- Get all the links on the page, including relative urls.
- Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
- repeat 2-4
All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider
User reviews
Safety
Risk impact
Wild Spider is risky to use as it requires a number of sensitive permissions that can potentially harm your browser and steal your data. Exercise caution when installing this extension. Review carefully before installing. We recommend that you only install Wild Spider if you trust the publisher.
Risk likelihood
Wild Spider has earned a fairly good reputation and likely can be trusted.
Promo images
Similar extensions
Here are some Chrome extensions that are similar to Wild Spider: