User-agent: * Allow: / Disallow: /polices/privacy-policy Clean-param: etext User-agent: Googlebot Disallow: *?lightbox= # Block PetalBot User-agent: PetalBot Disallow: / # Crawl delay for overly enthusiastic bots User-agent: AhrefsBot Crawl-delay: 10 User-agent: Yandex Clean-param: etext Clean-param: boxType&polarity&technology&size&price_min&price_max&capacity_min_value&capacity_max_value&sort Sitemap: https://www.tomakb.com/sitemap.xml