# robots.txt file to keep crawlers from indexing scripts, etc. User-agent: * Disallow: /boi Disallow: /ima Disallow: /scr Disallow: /sta Disallow: /fam Disallow: /pho Disallow: /onl Disallow: /gen Disallow: /dat Disallow: /cal Disallow: /obs