|
Server : Apache/2.4.62 System : FreeBSD fbsdweb2.web.rcn.net 14.1-RELEASE FreeBSD 14.1-RELEASE releng/14.1-n267679-10e31f0946d8 GENERIC amd64 User : www ( 80) PHP Version : 8.3.8 Disable Function : NONE Directory : /domains/kfoley/ |
Upload File : |
# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 User-agent: * Disallow: Disallow: /old/ Disallow: /logs/ Disallow: /_/ Disallow: /_/js/ Disallow: /_/css/ Disallow: /_/css/img/ User-agent: Googlebot # disallow all files ending with these extensions Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.gz$ Disallow: /*.cgi$ Disallow: /*.wmv$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.jpeg$ Disallow: /*.cgi$ Disallow: /*.xhtml$ Disallow: /*.wml$ Disallow: /*.pdf$ Disallow: /*.PDF$ Disallow: /*.exe$ Disallow: /*.swf$