# # Robots file for www.techdictionary.com # Contact Webmaster for changes to this file. # # $Id$ # # See # # # In addtion to the following information, the following meta tag # can also be used # # # # User-agent # # The value of this field is the name of the robot the record is # describing access policy for. # # If more than one User-agent field is present the record describes an # identical access policy for more than one robot. At least one field # needs to be present per record. # # The robot should be liberal in interpreting this field. A case # insensitive substring match of the name without version information is # recommended. # # If the value is '*', the record describes the default access policy # for any robot that has not not matched any of the other records. It is # not allowed to have two such records in the "/robots.txt" file. # # Disallow # # The value of this field specifies a partial URL that is not to be # visited. This can be a full path, or a partial path; any URL that # starts with this value will not be retrieved. For example, Disallow: # /help disallows both /help.html and /help/index.html, whereas # Disallow: /help/ would disallow /help/index.html but allow /help.html. # # Any empty value, indicates that all URLs can be retrieved. At least # one Disallow field needs to be present in a record. # # The presence of an empty "/robots.txt" file has no explicit associated # semantics, it will be treated as if it was not present, i.e. all # robots will consider themselves welcome. # User-agent: Googlebot Disallow: /ads Disallow: adback.html Disallow: /Database_drop Disallow: /disneyhotels Disallow: /feed Disallow: /file66donald691 Disallow: /hosting Disallow: /games/game Disallow: /games/gamepop.html Disallow: /hotels Disallow: /iphone/images Disallow: /iphone/game Disallow: /loans Disallow: /luxuryhotels Disallow: /mortgage Disallow: /pharmacy Disallow: /popjob.html Disallow: /popjobsong.html Disallow: /real-estate Disallow: /resources/bit Disallow: /resources/carparazzi Disallow: /resources/gts Disallow: /resources/guidetolongtermcare Disallow: /resources/longtermcareinsurance Disallow: /resources/longtermcareinsuranceca Disallow: /reversemortgage Disallow: /spywareinfo Disallow: /travel Disallow: /trip Disallow: /whitey.html User-agent: * Disallow: /ads Disallow: adback.html Disallow: /DataBases Disallow: /Database_drop Disallow: /email.txt Disallow: /emailcode.txt Disallow: /favicon.ico Disallow: /feed Disallow: /file66donald691 Disallow: /games/game Disallow: /games/gamepop.html Disallow: /images Disallow: /image2.gif Disallow: /iphone/game Disallow: /InternetTime.class Disallow: /js Disallow: /mailreply.html Disallow: /msoffice Disallow: /popjob.html Disallow: /popjobsong.html Disallow: /resources/bit Disallow: /resources/calendar.txt Disallow: /resources/clock.txt Disallow: /resources/copybottom.txt Disallow: /resources/InternetTime.class Disallow: /resources/timesnapshot.html Disallow: /resources/carparazzi Disallow: /resources/gts Disallow: /resources/guidetolongtermcare Disallow: /resources/longtermcareinsurance Disallow: /resources/longtermcareinsuranceca Disallow: /searchresultcount.txt Disallow: /sophist.css Disallow: /sophistdesk.css Disallow: /spywareinfo Disallow: /stats Disallow: /TechDictionary.wdgt.zip Disallow: /trip Disallow: /widget.html Disallow: /widget_search_results.html Disallow: /widget_search_error.html Disallow: /whitey.html