# Robots.txt # this file directs search bots # on what it should or should not visit and index # This file must be placed at the root of the website # for example: ebb.carolinagastransmission.com/robots.txt # if there are multiple sub-domains, # then this file must be in the root folder of each subdomain virtual directory # # for our website, the exact file locations are shown below: # \\wbez20\d$\inetpub\wwwroot\Robots.txt # \\wbez22\d$\inetpub\wwwroot\Robots.txt # \\wbez21v\d$\inetpub\wwwroot\Robots.txt # # the 2 entries below allow only the default page to be indexed # and disallow all other pages and folders # most bots use either the first match, or evaluate allow before disallow # User-agent: * Allow: /InformationalPostings/Default.aspx Disallow: / Disallow: *