Sitemap: https://www.website.com/sitemapindex.xml User-Agent: * Disallow: /_api/* Disallow: /_api/ Disallow: /verify-email/ Disallow: /cdn-cgi/ Disallow: /ad/* Disallow: /*?ev User-agent: meta-externalads crawl-delay: 10 Content-Signal: ai-train=yes, search=yes, ai-input=yes