User-agent: * Disallow: /webresources/submit_website.html Disallow: /webresources/submitted.html Disallow: /rd/ Disallow: /rd/?*