# Reference at http://www.outfront.net/tutorials_02/adv_tech/robots.htm # User-Agent: [Spider or Bot name] # Disallow: [Directory or File Name] # discussion at http://forums.searchenginewatch.com/showthread.php?t=2770&highlight=robots.txt # robots.txt generated at http://www.mcanerin.com/EN/search-engine/robots-txt.asp User-agent: * Disallow: /*jcalpro Disallow: /calendar/ Disallow: /events-calendar/ Disallow: /cgi-bin/ Disallow: /site/administrator/ Disallow: /site/installation/ Disallow: /site/logs/ Sitemap: http://www.pembrokediocese.com/site/english/sitemap.html