User-agent: Semrushbot-SA disallow: / User-agent: Semrushbot-SI Disallow: / User-agent: AhrefsBot Disallow: / User-agent: serpstatbot Disallow: / # http://www.majestic12.co.uk/projects/dsearch/mj12bot.php User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / # Sitemap files Sitemap: sitemap.php