प्लगिन ट्याग: crawler
-
Email Address Encoder
(160 कुल रेटिङ्गहरू)A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.
-
-
No-Bot Registration
(28 कुल रेटिङ्गहरू)Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.
-
Robots.txt rewrite
(2 कुल रेटिङ्गहरू)Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
Marquee image crawler
(1 कुल रेटिङ्गहरू)Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
-
Block Archive.org via WordPress robots.txt
(0 कुल रेटिङ्गहरू)Blocks the archive.org bots through the WordPress virtual robots.txt file.
-
Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …
(4 कुल रेटिङ्गहरू)Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …
-
Bisteinoff SEO Robots.txt
(4 कुल रेटिङ्गहरू)An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).
-
Block Chat GPT via robots.txt
(1 कुल रेटिङ्गहरू)Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
-
bodi0`s Bots visits counter
(5 कुल रेटिङ्गहरू)Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.
-
Block eCommerce Assets via robots.txt
(0 कुल रेटिङ्गहरू)Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Warmer – Cache Warmer and Cache Preload Crawler
(7 कुल रेटिङ्गहरू)Warm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.
-
Findkit – Site Search
(0 कुल रेटिङ्गहरू)Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.
-
Berq Markdown: Markdown Pages for AI & LLM Crawlers
(0 कुल रेटिङ्गहरू)Increase your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …
-
Crawl Hunt – Advanced SEO Optimization Tool
(1 कुल रेटिङ्गहरू)A powerful website crawler and monitoring tool for WordPress.
-
Block Common Crawl via robots.txt
(0 कुल रेटिङ्गहरू)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Block Feed and Comments via robots.txt
(0 कुल रेटिङ्गहरू)Blocks some Feed and Comment resources in order to avoid spam bots
-
Azayem Bots Tracker – Bot Visits Logger
(0 कुल रेटिङ्गहरू)A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).
-
Boring Cache Warmup Lite
(2 कुल रेटिङ्गहरू)A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.
-
GlobeSign Content Markdown Mirror
(0 कुल रेटिङ्गहरू)Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.