Skip to content
Gary Woodfine edited this page Aug 9, 2016 · 3 revisions

#What is Stop Web Crawlers At it core Stop Web Crawlers is simple free WordPress plugin to eradicate referrer spam affecting WordPress websites. The plugin has been developed by Three Nine Consulting in response to a number of their clients being affected by referrer spam.

In an effort to focus on eliminating this spam to ensure not only their own customers but also others do not get affected by referrer spam.

What is referrer spam

Technically speaking the referrer is a property of the HTTP request object sent by the browser to a web server identifying either the URL, IP Address or name of the Web link used to direct users to a Web page. Referrers are useful in statistical Web analysis in determining which sites provides generate the most traffic, and are key when formulate effective marketing strategies and even effective security processes.

Check out the following two resources for detailed explanations

How does Stop Web Crawlers block referrer spam ?

Essentially the plugin will parse each individual request to the website, check it's referrer property and if the referrer matches an address from over 1200 known referrer spam URL's that request is redirected to 403 Access is Forbidden page.

Will the plugin remain free ?

Absolutely! The best way to eliminate referrer spam is to ensure everyone has easy and inexpensive access to the protection.

Contributions

If you have a few ideas for the product and would like to contribute just let us know

If this project has helped you and you would like to share the love and buy us coffee you can Donate via PayPalor buy something from our Amazon wish list

Clone this wiki locally