Site Crawler

Crawl a website for a Sitemap, Links and Images.

2.67 (Rating count: 3)

Recent rating average: 2.67

All time rating average: 2.67

Date	Author	Comment
2021-09-17	Su Jeff	没有Unicode支持，中文网站全是乱码！
2020-08-18	Robert Campbell	Have to crawl one pages one at a time, so if you have an entire site you need to crawl it is not worth installing. Did not work on an JS generated page.
2019-01-09	SiteForward Digital Program	This is excellent, exactly what I was looking for. We were able to quickly scrape old websites for clients, and ensure we were capturing all the hidden pages or broken links.