web pages are crawled by being loaded into browser using multiple tabs parallelly
What is Wild Spider?
Wild Spider is a Chrome extension that allows web pages to be crawled by being loaded into the browser using multiple tabs parallelly. It uses the current URL as the starting point and fetches all the links on the page to open them in multiple tabs. Please note that the more tabs you use, the more computer resources will be used.
Extension stats
By: Xuan Wu
Rating: 1.00
(1)
Creation date: 2019-03-08
Risk impact: High risk impact
Risk likelihood: Low risk likelihood
Manifest version: 2
Permissions:
Size: 123.90K
Other platforms
Not available on Firefox
Not available on Edge
Want to check extension ranking and stats more quickly for other Chrome extensions?
Install
Chrome-Stats extension
to view Chrome-Stats data as you browse the Chrome Web Store.
Extension summary
WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).
The "spider" works in this way:
- The current url is used as the starting point, and it's loaded again in a new tab.
- After this page is loaded, fetch all the links on the page.
- Get all the links on the page, including relative urls.
- Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
- repeat 2-4
All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider
User reviews
doesnt work
Extension safety
Risk impact
Wild Spider requires some sensitive permissions that could impact your browser and data security. Exercise caution before installing.
Risk likelihood
Wild Spider has earned a fairly good reputation and likely can be trusted.
Upgrade to see risk analysis details
Promo images
Similar extensions
Here are some Chrome extensions that are similar to Wild Spider:
Fun Crawler JIRA Crawler Page Crawler Creeper Semantic Spider Link Collector Recursive LinkAnalysis beABot Scraper Crawler V3 Crawler Spider Free - The simplest web scraper
Brett Sykes
2.33
58
ddly
5.00
24
ousaliacoding
5.00
2,000+
hui.chu
3.25
207
https://www.w3.org/2013/04/semweb-html5
4.00
428
attilathedud
3.00
538
mike.cann
3.42
565
https://nerdstogeeks.com
4.56
282
https://williamnharvey.com
3.67
127
Open Source Dev
2.29
2,000+
Dollar
3.17
1,000+
https://amie-chen.com
3.89
8,000+