外掛標籤: crawler
-
Warmer – Automatic Cache Warmer and Pre-loader
(0 次評分次數)Automatically warm up your WordPress site's cache by crawling pages to ensure optimal performance for your visitors.
-
Robots.txt Extender
(0 次評分次數)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
rexCrawler
(0 次評分次數)rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show them on pages.
-
JaspreetChahal’s wordpress bot detector lite
(1 次評分次數)This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …
-
AI Deny
(0 次評分次數)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
SEObot Monitor for Googlebot, Bingbot and search engine spiders
(0 次評分次數)With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …
-
Page Modified
(1 次評分次數)Display the results of your Page Modified crawls right within your WordPress Admin.