A few things to consider when developing on a public domain

By David Pratt / Tags: / No Comments / Published: 14-03-10

If you ever find yourself developing a site on a public facing domain, it is always a good idea to have measures in place to prevent search engines indexing it in the event that a stray link enables a search engine spider to find it. A few of the things that you can do are…

Ensure the document head of each page has the “noindex” meta tag. This statement tells search engine spiders to not index any of the content on the current page.

<meta name="robots" content="noindex" />

Ensure the document head of each page has the “nofollow” meta tag. This statement tells search engine spiders to not follow any links on the page.

<meta name="robots" content="nofollow" />

Add a rule to the robots.txt file that prevents search engine spiders from accessing the site.

User-agent: *
Disallow: /

Just remember to remove these measures when you launch the site!

Category: Tech

Tags:

Posted: on March 14th, 2010 at 7:07 pm.

Feeds: RSS 2.0

Leave a reply