User-agent: * Disallow: /?s= Disallow: /?perpage= Disallow: *product_cat* Sitemap: https://www.ig-groupuk.com/sitemap_index.xml User-agent: BLEXBot Disallow: / User-agent: Meta-ExternalAgent Crawl-delay: 2 User-agent: meta-webindexer Crawl-delay: 2