# This file is automatically added by Rank Math SEO plugin to help a website index better # More info: https://rankmath.com/?utm_source=Plugin&utm_medium=Robots&utm_campaign=WP User-Agent: * Disallow: /wp-admin/ Disallow: /wp-access/ Allow: /wp-admin/admin-ajax.php Crawl-delay: 10 # --- AI / LLM CRAWLER ACCESS (ADD ABOVE YOUR EXISTING RULES) --- # Purpose: Ensure major AI crawlers are NOT inadvertently blocked if your default rules are restrictive. User-agent: GPTBot Allow: / User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / # (Optional) Add others as needed for your environment/logs: # User-agent: Applebot-Extended # Allow: / # Keep your existing WordPress/SEO plugin rules below. # Make sure you still disallow sensitive paths if desired (e.g., /wp-admin/). Sitemap: https://designatwork.com/sitemap_index.xml