Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...How Do I Keep From Being Indexed?How Do I Keep From Being Indexed?
Previous
 
Next
New Post
3/3/2007 12:00 AM
 
I've set up my DNN site, but how do I prevent the search engine spyders from crawling it - I want it to be kept private.  I know I can password protect the page, but that's a little redundant - is there a way to add a "nofollow" tag similar to HTML?
 
New Post
3/3/2007 1:00 PM
 
You should find how to do it here: http://www.robotstxt.org/wc/exclusion.html
 
New Post
3/3/2007 3:29 PM
 

You could use a Robots.txt file with the entries below:

User-Agent: *
Disallow: /

The major search engines are supposed (and usually do) respect your specifications in the robots file but you have to understand that this is not mandatory.  Also, if your site has been up for a while it may have been indexed already, so you have to keep all this in mind from the very beginning.  Once you are indexed it may be difficult to get of.

Carlos

 

 
New Post
3/18/2007 7:33 PM
 

Thanks for the info...

To make sure I have it all corrcetly, is this what I would do:

Create a robots.txt file

enter the following text:

User-agent: *
Disallow: /enter_extension_to_block_here
Disallow: /enter_another_extension_to_block_here

and so on..

Then simply publish it to the server?

 

 
Previous
 
Next
HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...How Do I Keep From Being Indexed?How Do I Keep From Being Indexed?


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out