Wild Spider

web pages are crawled by being loaded into browser using multiple tabs parallelly

What is Wild Spider?

Wild Spider is a Chrome extension that allows web pages to be crawled by being loaded into the browser using multiple tabs parallelly. It uses the current URL as the starting point and fetches all the links on the page to open them in multiple tabs. Please note that the more tabs you use, the more computer resources will be used.

Download

Stats

By: Xuan Wu

View on Chrome Web Store

Users: 47 ▲ 1

Rating: 1.00 (1)

Version: 0.0.3 (Last updated: 2019-03-08)

Creation date: 2019-03-08

Risk impact: High risk impact

Risk likelihood: Low risk likelihood

Manifest version: 2

Permissions:

tabs
activeTab
webNavigation

Size: 123.90K

URLs: Website

Stats date:

Chrome-Stats Rank

# 77235 ▲ 784

Other rankings

#4657 in Tools ▼ 49

Other platforms

Not available on Firefox

Not available on Edge

Want to check extension ranking and stats more quickly for other Chrome extensions? Install Chrome-Stats extension to view Chrome-Stats data as you browse the Chrome Web Store.

Summary

Analyze keywords

WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).

The "spider" works in this way:

The current url is used as the starting point, and it's loaded again in a new tab.
After this page is loaded, fetch all the links on the page.
Get all the links on the page, including relative urls.
Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
repeat 2-4

All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider

User reviews

doesnt work

Matt C, 2018-03-19

View all user reviews

Safety

Risk impact

Wild Spider is risky to use as it requires a number of sensitive permissions that can potentially harm your browser and steal your data. Exercise caution when installing this extension. Review carefully before installing. We recommend that you only install Wild Spider if you trust the publisher.