# Global robots config User-agent: * Disallow: /*?* Allow: /*js* Allow: /*css* # robots.txt for https://agency.reuters.com/ Disallow: /404.html Disallow: /en/input-page/* Disallow: /news-agency/60279341234/*