# robots.txt for https://redcrewcareers.com/ Sitemap: https://redcrewcareers.com/sitemap.xml # live - don't allow web crawlers to index cpresources/ User-agent: * Disallow: /cpresources/ Disallow: /webpack/ Disallow: /dist/