User-agent: * Allow: / Allow: /spaceweather/ Allow: /photos/ User-agent: * Disallow: /library/ User-agent: * Disallow: /library/* User-agent: * Disallow: /library/*.pdf$ User-agent: * Disallow: /library/*.djvu$ User-agent: * Disallow: /library/*.txt$ User-agent: * Disallow: /library/*.epub$ User-agent: * Disallow: /library/*.lit$ User-agent: * Disallow: /library/*.chm$ User-agent: Zombies Disallow: /brains User-agent: Killer AI Disallow: /~superkuh/ User-agent: The person who is reacting to the lame jokes that is reading this robots.txt right now. Yes, you. Allow: /hello/awarenessofthemeta/ User-agent: Unscrupulous bots Allow: /visitingthisurlisasignalthatyouarealgorithmicseriouslypleasedontvisitthisturlactualpeople/ # http headers for unicode art, dns TXT records for inspirational messages