Etiqueta del plugin: crawler
-
GoBookMart Robots Editor
A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
GoVISIBLE AI Bot Tracker
Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.
-
JaspreetChahal’s wordpress bot detector lite
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …
-
Trackbase Analytics
Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.
-
SEObot Monitor for Googlebot, Bingbot and search engine spiders
With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …
-
-
Rankal LLMs.txt – Get Cited by ChatGPT, Claude & Perplexity
Generate and serve a dynamic, cached /llms.txt AI context index. An add-on that works in partnership with Rankal SEO Optimizer.
-
FacetFence Product Filters
Protect WooCommerce filtered URLs from crawl floods with noindex/canonical controls, signed cookies, rate limits, logs, and rollback.
-
-
LLMAffiliate AI Traffic Monetizer
Detect LLM user agents, enforce Google parity, and serve enhanced content through a configurable content service.
-
Valvai – AI Traffic Control Center
Block, log and monetise AI crawlers directly from your WordPress dashboard.
-
Spuncin
Blocks AI crawlers that collect your content to train models. Search engines and link previews are never touched.
-
AI Kansoku Lab Tracker
Track AI crawler visits such as GPTBot, ClaudeBot, and PerplexityBot server-side and visualize them in WordPress.
-
AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control
Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
-
AI Bot Monitor
Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.
-
ADG Markdown for AI Crawlers
Serve AI crawlers clean Markdown of your content on the same URL, and auto-generate llms.txt / llms-full.txt (with an on-disk fallback).
-
Promium AI GEO
Write a dedicated version of any post or page for AI crawlers such as GPTBot, ClaudeBot and PerplexityBot, and choose which bots may read it.
-
BotObservatory – Live Bot Tracker & Anti-Scraper
Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.
-
Zicy AI Access Monitor
Monitor known AI crawlers and AI assistant fetches, with daily rollups, CSV exports, weekly summaries, and page briefs.
