robots.txt and seo Tag

News Flash: The Web Is Huge. By current estimates there are over 38 billion pages that have been indexed by Google, and that represents just a small slice of the what is actually out there. Search engines use automated processes called "robots" to scan the internet....