# /robots.txt for www.sph.umich.edu # our search software (or someone posing as our search software) # can index the tech pages, otherwise rules are same as * User-agent: htdigumsph Disallow: /computing/manuals/ Disallow: /phisa/tech/manuals/ Disallow: /computing/unindexed/ Disallow: /phisa/tech/unindexed/ Disallow: /cgi-bin Disallow: /sphinfo Disallow: /group/sphinfo # Disallow: /scr User-agent: * # see JDA concerning why /phisa/tech is listed here # Disallow: /phisa/tech/ # Disallow: /computing/ Disallow: /computing/unindexed/ Disallow: /phisa/tech/unindexed/ Disallow: /computing/manuals/ Disallow: /phisa/tech/manuals/ Disallow: /cgi-bin Disallow: /sphinfo Disallow: /group/sphinfo # disallow non-viable websites Disallow: /index2.html Disallow: /aah/ Disallow: /aapha/ Disallow: /admissions/ Disallow: /ahd/ Disallow: /aps/ Disallow: /arsenic/ Disallow: /bioterrorism/ Disallow: /career_networking/ Disallow: /cdtrack/ Disallow: /cbph/ Disallow: /chsp/ Disallow: /compton_fellows/ Disallow: /downtime/ Disallow: /ehstest/ Disallow: /errors/ Disallow: /exec-masters/ Disallow: /fogartysa/ Disallow: /geneticsed/ Disallow: /genetics/pdf/ Disallow: /genpolicy/ Disallow: /geomed/ Disallow: /ghtemp/ Disallow: /heb/ Disallow: /hmesn/ Disallow: /hsat/ Dissallow: /logic_solutions_preview_site/ Disallow: /mcech/ Disallow: /mi_info/ Disallow: /micphp/ Disallow: /miih/ Disallow: /mlaguide/ Disallow: /napha/ Disallow: /ni-stat/ Disallow: /pace/ Disallow: /ph-consortium/ Disallow: /phfwh/ Disallow: /phgtemp/ Disallow: /phisaint/ Disallow: /pkg_files/ Disallow: /practice/ Disallow: /preventive_med/ Disallow: /profisar/ Disallow: /proxy/ Disallow: /qphaab/ Disallow: /scr/research2/ Disallow: /rwh/ Disallow: /rwhtemp/ Disallow: /rwj/ Disallow: /sahp/ Disallow: /sgph/ Disallow: /sophas/ Disallow: /tranan/ Disallow: /triadstudy/ Disallow: /yvpc/ # disallow all archival site folders Disallow: /about/dev/ Disallow: /academics/site121907/ Disallow: /admissions/site101907/ Disallow: /alumni/site113007/ Disallow: /biostat/site071608/ Disallow: /ehs/site111408/ Disallow: /epid/site060109/ Disallow: /epid/GSS/archive011806/ Disallow: /epid/GSS/old/ Disallow: /faculty_research/site092507/ Disallow: /genomics/site042408/ Disallow: /hbhe/dev/ Disallow: /hmp/dev/ Disallow: /prc/site081408/ Disallow: /students/site101907/ Disallow: /pfps/site061509/ Disallow: /computing/archived62309/ Disallow: /computing/web073008/ Disallow: /news_events/findings/fall06/news/three.htm # if cgi-bin is ever removed from this file, add /cgi-bin/man2html # to prevent the indexing of every UNIX man page Disallow: /cgi-bin Disallow: /sphinfo # Disallow: /scr