Wild Spider

web pages are crawled by being loaded into browser using multiple tabs parallelly
What is Wild Spider?
Wild Spider is a Chrome extension that allows web pages to be crawled by being loaded into the browser using multiple tabs parallelly. It uses the current URL as the starting point and fetches all the links on the page to open them in multiple tabs. Please note that the more tabs you use, the more computer resources will be used.

Extension stats

By: Xuan Wu
Users: 39 ▼ -2
Rating: 1.00 (1)
Version: 0.0.3 (Last updated: 2019-03-08)
Creation date: 2019-03-08
Risk impact: High risk impact
Risk likelihood: Low risk likelihood
Manifest version: 2
Permissions:
  • tabs
  • activeTab
  • webNavigation
Size: 123.90K

Ranking

Other rankings
#7135 in Tools ▼ 98

Other platforms

Not available on Firefox
Not available on Edge
Want to check extension ranking and stats more quickly for other Chrome extensions? Install Chrome-Stats extension to view Chrome-Stats data as you browse the Chrome Web Store.

Extension summary

WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).

The "spider" works in this way:

  1. The current url is used as the starting point, and it's loaded again in a new tab.
  2. After this page is loaded, fetch all the links on the page.
  3. Get all the links on the page, including relative urls.
  4. Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
  5. repeat 2-4

All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider

User reviews

doesnt work
by Matt C, 2018-03-19
View all user reviews

Extension safety

Risk impact

Wild Spider requires some sensitive permissions that could impact your browser and data security. Exercise caution before installing.

Risk likelihood

Wild Spider has earned a fairly good reputation and likely can be trusted.

Upgrade to see risk analysis details

Promo images

Wild Spider small promo image
Small promo image

Similar extensions

Here are some Chrome extensions that are similar to Wild Spider: