NSE LIB

Back to library
Official safe Default

http-robots.txt

Checks for disallowed entries in /robots.txt on a web server.

Ports

Any

Protocols

n/a

Attribution

Nmap Project

Usage

Copy the command and adjust the target or script arguments as needed. 

nmap -sV -sC <target>

Overview

Checks for disallowed entries in /robots.txt on a web server. The higher the verbosity or debug level, the more disallowed entries are shown.