User-agent: *

Disallow:



User-agent: wget

User-agent: webzip

User-agent: webmirror

User-agent: webcopy

Disallow: /cgi-bin/