प्लगिन ट्याग: robots.txt
-
-
Check Search Engine Visibility on Migration
(1 कुल रेटिङ्गहरू)Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.
-
Unblock CSS & JS for Googlebot
(0 कुल रेटिङ्गहरू)Modifies robots.txt to allow Googlebot access JS and CSS files.
-
CeeWP Robots.txt Manager
(0 कुल रेटिङ्गहरू)Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
-
Block Feed and Comments via robots.txt
(0 कुल रेटिङ्गहरू)Blocks some Feed and Comment resources in order to avoid spam bots
-
Block Common Crawl via robots.txt
(0 कुल रेटिङ्गहरू)Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
AI Deny
(1 कुल रेटिङ्गहरू)Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
-
LJPL Armored robots.txt
(0 कुल रेटिङ्गहरू)Add some directives to your robots.txt file to keep your site safer
-
ChatBot Blocker by CellarWeb
(0 कुल रेटिङ्गहरू)ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.
-
Copyright AI Content Licensing – Block AI Crawlers + Get Paid
(0 कुल रेटिङ्गहरू)AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
-
Thin Content Manager
(1 कुल रेटिङ्गहरू)See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.
-
Robots.txt Extender
(0 कुल रेटिङ्गहरू)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
AWP Disallow Root Control
(4 कुल रेटिङ्गहरू)Disallow access to the root directory via robots.txt with an option to enable or disable.
-
AI Rights Protection by SimpleFeed
(1 कुल रेटिङ्गहरू)Protect your rights by reviewing and blocking AI bots from using your content without compensation.
-
GoBookMart Robots Editor
(1 कुल रेटिङ्गहरू)A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.
-
Advanced SEO Toolkit
(0 कुल रेटिङ्गहरू)Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.
-
Block old browser versions and suspicious browsers
(0 कुल रेटिङ्गहरू)With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.
-
Check System Details
(0 कुल रेटिङ्गहरू)Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.
-
IntentDeep Virtual Files – AI-Ready: Robots.txt, Security.txt, Ads.txt, LLMS.txt
(1 कुल रेटिङ्गहरू)Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.
-
LLMs.txt – AI Website Content Crawling
(0 कुल रेटिङ्गहरू)Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.