# Global rules for all legitimate crawlers User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ Disallow: /old-url/ Disallow: /login/ Disallow: /register/ Disallow: /cart/ Disallow: /checkout/ Disallow: /search/ Disallow: /wp-admin/ Disallow: /cgi-bin/ Disallow: /*? # Blocks dynamic URLs with query parameters # Allow assets Allow: /css/ Allow: /js/ Allow: /images/ # === Block known bad or aggressive bots === User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DotBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: Yandex Disallow: / User-agent: PetalBot Disallow: / User-agent: Sogou Disallow: / User-agent: Baiduspider Disallow: / User-agent: MauiBot Disallow: / User-agent: MegaIndex.ru Disallow: / # === OPTIONAL: Crawl delay for all bots (reduce server load) === # Uncomment if needed # Crawl-delay: 10 # === Sitemap for indexing === Sitemap: https://gameonsolution.in/sitemap.xml