# 🚨 Warning: Disobeying these rules will result in an IP ban! 🚨 User-agent: * Allow: / Disallow: /admin/ Disallow: /includes/ Disallow: /tmp/ Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /backup/ Disallow: /logs/ Disallow: /config/ Disallow: /private/ Disallow: /search?q= Crawl-delay: 10 # ✅ ALLOW Google & Major Search Engines User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / User-agent: Googlebot-Video Allow: / User-agent: Google-Site-Verification Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / User-agent: Yahoo! Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: Applebot Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / User-agent: Sogou Allow: / User-agent: SeznamBot Allow: / # 🔥 Extra AI Bots & Knowledge Graph Bots Allowed User-agent: OpenAIBot Allow: / User-agent: ChatGPTBot Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: WikiBot Allow: / User-agent: WikipediaBot Allow: / User-agent: KnowledgeGraphBot Allow: / User-agent: TheKnowledgeGraphBot Allow: / # 📱 Social Media Bots - ALLOWED User-agent: Facebot Allow: / User-agent: Twitterbot Allow: / User-agent: Facebookbot Allow: / User-agent: LinkedInBot Allow: / User-agent: TelegramBot Allow: / User-agent: WhatsApp Allow: / User-agent: Pinterestbot Allow: / User-agent: Redditbot Allow: / User-agent: Discordbot Allow: / User-agent: Slackbot Allow: / User-agent: InstagramBot Allow: / User-agent: TikTokBot Allow: / User-agent: QuoraBot Allow: / User-agent: MediumBot Allow: / # 🗄️ Archive & Wayback Machine - ALLOWED User-agent: Archive.org_bot Allow: / User-agent: Internet-Archive Allow: / User-agent: ArchiveIt Allow: / User-agent: Bytespider Allow: / # ❌ BAD BOTS - BLOCKED ❌ User-agent: asterias Disallow: / User-agent: BackDoorBot Disallow: / User-agent: Black Hole Disallow: / User-agent: BlowFish Disallow: / User-agent: BotALot Disallow: / User-agent: CherryPicker Disallow: / User-agent: CopyRightCheck Disallow: / User-agent: discobot Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Fasterfox Disallow: / User-agent: Fetch Disallow: / User-agent: HTTrack Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Missigua Locator Disallow: / User-agent: moget Disallow: / User-agent: NetAnts Disallow: / User-agent: Openfind Disallow: / User-agent: RepoMonkey Disallow: / User-agent: SiteSnagger Disallow: / User-agent: SpankBot Disallow: / User-agent: SpiderKU Disallow: / User-agent: Steeler Disallow: / User-agent: Teleport Disallow: / User-agent: TurnitinBot Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSauger Disallow: / User-agent: WebStripper Disallow: / User-agent: WebZIP Disallow: / User-agent: Wget Disallow: / User-agent: Zeus Disallow: / User-agent: ZyBORG Disallow: / User-agent: Atomic_Email_Hunter Disallow: / # 🛑 Prevent Fake Bots & AI Scrapers User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: PetalBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: GPTBot Disallow: / User-agent: CommonCrawl Disallow: / User-agent: DataForSEO Disallow: / User-agent: DeepCrawl Disallow: / User-agent: ScreamingFrog Disallow: / User-agent: Scrapy Disallow: / User-agent: Apache-HttpClient Disallow: / User-agent: HTS Disallow: / User-agent: webwhacker Disallow: / # 🚀 Smart Image Indexing Control User-agent: Googlebot-Image Allow: /uploads/ User-agent: Bingbot-Image Allow: /uploads/ User-agent: Yahoo! Slurp-Image Allow: /uploads/ User-agent: Baiduspider-image Allow: /uploads/ # 🌍 Allow CSS, JS, and API Access User-agent: * Allow: /wp-content/themes/ Allow: /wp-content/plugins/ Allow: /wp-includes/js/ Allow: /wp-json/ # 📌 Prevent Sensitive File Access User-agent: * Disallow: /*.php$ Disallow: /*.sql$ Disallow: /*.zip$ Disallow: /*.tar$ Disallow: /*.gz$ Disallow: /*.log$ Disallow: /*.bak$ # 🚀 Sitemap for SEO Boost Sitemap: https://amadersomaj.com/sitemap.xml