#all notes should appear on a line by themselves like this without a space before the # at the beginning of the sentance and lower case

#the directive has two parts that are required by the The Robots Exclusion Standard

#the User-Agent and at least 1 disallow

#The user-agent refers to a spider or robot by name (googlebot) or all with the wildcard ("*") 

#using the wildcard ("*") after the User-Agent allows all robots to index all files and directories in the root directory

#the disallow: directive is used to stop spiders and robots from indexing: files (stats.htm) and directories (/stats/)

#leaving the disallow: directive blank indicates that aLL files and or directories may be crawled or retrieved

#we typically allow all files and directories to be indexed and block the stats directory with this directive

#note that this directive does not protect the stats directory as some spiders ignore the robots.txt file 

User-agent: *
Disallow: /stats/
Disallow: /secure/