# START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://www.thornewidgery.co.uk/sitemap_index.xml # --------------------------- # END YOAST BLOCK # Block from crawling folders User-agent: * User-agent: AdsBot-Google Disallow: /newswires Disallow: /pdf Disallow: /stationery Disallow: /docs Disallow: /files