Robots Exclusion Checker

Checks robots.txt, meta robots, x-robots-tag with URL alerts. Canonical warnings, HTTP header info. An SEO extension, robots tester.

What is Robots Exclusion Checker?

"Robots Exclusion Checker" is a Chrome extension that visually indicates robots exclusions that may prevent your page from being indexed by search engines. It analyzes factors like robots.txt rules, meta and x-robots tags, canonical mismatches, and link attributes to help SEO professionals optimize their sites. Ideal for auditing and resolving crawl issues, this tool is essential for anyone in digital marketing looking to enhance their website's performance in organic search results.

Download

Extension stats

By: https://www.samgipson.com

View on Chrome Web Store

Users: 40,000+

Rating: 4.84 (32)

Version: 1.2.0.11 (Last updated: 2024-08-29)

Creation date: 2020-04-02

Risk impact: Low risk impact

Risk likelihood: Very low risk likelihood

Manifest version: 3

Permissions:

storage

Size: 189.44K

Email: ex*****@samgipson.com

URLs: Website ,Privacy policy

Ranking

# 4607 ▼ 10

Other rankings

#72 in Developer Tools

#45 in checker keyword 63 ▼ 1

#81 in rule keyword 8 ▼ 2

#106 in flag keyword 22 ▲ 2

#126 in header keyword 26 ▼ 5

Upgrade to see more rankings

Other platforms

Not available on Firefox

Robots Exclusion Checker (v1.1.5)

5.00

(1) 588

Want to check extension ranking and stats more quickly for other Chrome extensions? Install Chrome-Stats extension to view Chrome-Stats data as you browse the Chrome Web Store.

Extension summary

Analyze keywords

Robots Exclusion Checker is designed to visually indicate whether any robots exclusions are preventing your page from being crawled or indexed by Search Engines.

The extension reports on 5 elements:

Robots.txt
Meta Robots tag
X-robots-tag
Rel=Canonical
UGC, Sponsored and Nofollow attribute values

Robots.txt

If a URL you are visiting is being affected by an "Allow” or “Disallow” within robots.txt, the extension will show you the specific rule within the extension, making it easy to copy or visit the live robots.txt. You will also be shown the full robots.txt with the specific rule highlighted (if applicable). Cool eh!

Meta Robots Tag

User reviews

These summaries are automatically generated weekly using AI based on recent user reviews. Chrome Web Store does not verify user reviews, so some user reviews may be inaccurate, spammy, or outdated.

Pros

User-friendly interface
Effective for checking and validating robots.txt files
Helps determine page index status without opening the plugin
Time-saving for SEOs and webmasters
Highly recommended by users

Cons

Interferes with caching, causing redirect errors
Adds a noticeable red dotted border box around links
High memory usage compared to other extensions
Lacks NOINDEX link highlighting option
Changes in robots.txt are not reflected immediately

Most mentioned

Great for SEO and webmasters
Helps with robots.txt management
User issues with dotted border box and caching
High memory footprint reported
Developer responsiveness is appreciated

Recent reviews

Does the job but interferes with caching, resulting in "Too many redirect" errors on some websites (like Gitlab).

Konrad Jurk, 2024-09-24

Save this extension from extinction, Please

Salman M, 2024-08-26

this extension adds an annoying red dotted border box around certain links, when working on websites, this becomes an issue as i just spent the last 3 hours going through my 100+ extensions one at a time to narrow it down. I understand this extension helps with checking robots.txt exclusion, but there was nothing telling me that this was being caused by your extension, you need some type of info next to it, so people know your extension is doing this. Otherwise this extension is great *** Update *** went through the settings and see there is an option called nofollow thats preselected that says highlights in red. I disabled that and the dotted border line is gone. You should really have something either on a highlight or a popup box saying that the dotted border line is being caused by your extention, even did an inspect and couldnt figure out what extension was causing it, looked it up google, and google said it was an accessibility issue. I have rerated this plugin as 5 stars now