# robots.txt for http://www.astro.washington.edu # Exclude the website statistics from robots as this tends to generate # more than 100 uninteresting links on the search engines. User-agent: * Disallow: /pwebstats/ Disallow: /smith/ Disallow: /reiss/Javaroids/Javaroids.html Disallow: /sdss/