Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...Best way to block crawlers & robots from accessing a Public page?Best way to block crawlers & robots from accessing a Public page?
Previous
 
Next
New Post
8/16/2010 11:19 AM
 
I'm wondering what the best approach is for blocking robots/crawlers from a Public page. I'd like to have a "hidden page" where I can email someone a link and they can immediately access the page. It needs it to be a Public page (i.e., I don't want to make people login/register). I also need to ensure it doesn't get indexed by any search bots/crawlers. What's the best approach? (I'm on DNN 4.08.04.) Thanks! - John 
 
New Post
8/17/2010 8:37 PM
 
you can do this via a robots.txt file (see http://www.robotstxt.org/ ), but it's just "security by obscurity" as the page is still open to anyone who knows the address (or is clever enough to open the robots.txt file and see it - only search engines respect this file, not other people :) )

Buy the new Professional DNN7: Open Source .NET CMS Platform book Amazon US
 
Previous
 
Next
HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...Best way to block crawlers & robots from accessing a Public page?Best way to block crawlers & robots from accessing a Public page?


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out