skip to main content

TAMU Webmaster's Blog


Information and insight from the A&M Webmasters

Help us with the university search index

November 1st, 2007 by Erick Beck

With regard to the university search engine, if you as a web administrator know that you have web sites or directories that shoud not be in the index, *PLEASE* set up a robots.txt file to exclude those files.

The contents of the robots file should be as follows:

User-Agent: tamu-googlebot
Disallow: /path/to-be/excluded/

Thursday, November 1st, 2007 Ongoing Projects, Search
Share this article

No comments yet.

Leave a comment

Categories

Archives