# Robots.txt file created by 17/01/2009 # For domain: http://www.dreamfacto.com # # All other robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /admin/ Sitemap: http://www.dreamfacto.com/sitemap.xml Sitemap: http://www.dreamfacto.com/sitemap.txt Sitemap: http://www.dreamfacto.com/sitemap.htm Sitemap: http://www.dreamfacto.com/site-map.html sitemap: http://www.dreamfacto.com/generator/data/sitemap.html Sitemap: http://www.dreamfacto.com/ror.xml Sitemap: http://www.dreamfacto.com/generator/data/urllist.txt