User-Agent: slurp 
Allow: / 

User-Agent: * 
Allow: /