OWASP Mutillidae II: Web Pwn in Mass Production
|
|
|
|
Robots.txt
|
Sites use the robot.txt file in the site root to discourage web crawlers from
indexing site content. Robots.txt is a plain text file which can be read by
site visitors. In some cases, the robots.txt file will point to sensitive
pages or directories. If a sensitive file is placed in robots.txt without
proper authorization controls protecting the file, site visitors may discover
the contents and browse to the files. More information is available at
Robots Exclusion Standard
|
|
|