Virtual Robots.txt
Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be…
Etiqueta del plugin: crawler
Robots.txt Editor
Robots.txt for WordPress
WordPress Robots.txt optimizer (+ XML Sitemap) – Boost SEO, Traffic & Rankings
All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, …),…
PHPEnkoder
Encodes mailto: links and e-mail addresses with JavaScript to stifle webcrawlers. Automatically turns plaintext e-mails…
Robots.txt rewrite
Provide the easy managment of your robots.txt from admin side. It propose you the advanced…
WordPress Meta Keywords
This plugin gives you the ability to set Meta Keywords in WordPress. Under pages it…
Crawl Optimization
The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing…
WordPress Meta Description
With this plugin you can control the text which will be shown as description on…
Marquee image crawler
Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left…
Block Archive.org via WordPress robots.txt
Blocks the archive.org bots through the WordPress virtual robots.txt file.
Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …
Mass ping tool for SEO plugin is one of the fastest ways to get indexed…
Advanced Robots.txt Optimizer & Editor
The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management…
DB Robots.txt
DB Robots.txt automatically creates a virtual file robots.txt including special rules for Google and Yandex.…
Block Chat GPT via robots.txt
Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through…
bodi0`s Bots visits counter
Counts the visits from web spiders, crawlers and bots in your blog, with ability to…
Block eCommerce Assets via robots.txt
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
WordPress Stop and Block bots plugin Anti bots
Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and…
Hide Email Address
Protect email address from being collected by web crawlers.
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI…