User-agent: * Allow: / # Block PHP endpoints from indexing Disallow: /clean.php Disallow: /elementor.php # Explicitly allow social media crawlers User-agent: facebookexternalhit Allow: / User-agent: Facebot Allow: / User-agent: LinkedInBot Allow: / User-agent: Twitterbot Allow: / User-agent: WhatsApp Allow: /