Comments on: Robots.txt file: The good, the bad, The Whitehouse http://elastique.com.au/web-design-blog/robotstxt-file-the-good-bad-the-whitehouse/ Sydney Web Design, Development, SEO & Web Marketing Blog | Elastique Web Design Blog Sydney Fri, 09 Oct 2009 04:00:40 +1100 http://wordpress.org/?v=2.8.4 hourly 1 By: Robert J. Koenig http://elastique.com.au/web-design-blog/robotstxt-file-the-good-bad-the-whitehouse/comment-page-1/#comment-955 Robert J. Koenig Wed, 03 Jun 2009 13:11:07 +0000 http://elastique.com.au/web-design-blog/?p=315#comment-955 Great article- as it explains the logic and provides examples. But the examples wander around too much. No - here is my question. Will this robot.txt in the root directory stop ethical indexing engines: User-agent: * Disallow: /path Great article- as it explains the logic and provides examples.

But the examples wander around too much.

No – here is my question. Will this robot.txt in the root directory stop ethical indexing engines:

User-agent: *
Disallow: /path

]]>