User-agent: * Allow: / Disallow: # Amazon's user agent User-agent: Amazonbot Disallow: /