SEO & robots.txt & robots meta tag

Are you using a robots.txt file or robots mega tag for robots on your website ?

http://en.wikipedia.org/wiki/Robots.txt
http://www.robotstxt.org/wc/robots.html

robots.txt
http://www.searchtools.com/robots/robots-txt.html

User-agent: * Disallow: /     

meta tag
http://www.robotstxt.org/wc/meta-user.html

[meta name="robots" content="noindex,nofollow"]

A formal syntax for the Robots META tag content is:

content    = all | none | directives     all        = "ALL"     none       = "NONE"     directives = directive ["," directives]     directive  = index | follow     index      = "INDEX" | "NOINDEX"     follow     = "FOLLOW" | "NOFOLLOW"

Read and post comments | Send to a friend