# robots.txt # linode.aczoom.com: not really used for anything here. # disallow - specifies a partial URL that is not to be visited. # This can be a full path, or a partial path; any URL that starts with # this value will not be retrieved. # Not all folders listed here - since some people use robots.txt to # find folder names and look around! If dir browsing is disabled # in server, or if default file (index.html, etc) exists, then # browsers can't find folders (unless they are linked), so that is # another way to hide folders - don't link to them from any visible html # file. User-agent: * Crawl-Delay: 1 Disallow: /dpl7/