Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...How to tell if a request is a search bot or a humanHow to tell if a request is a search bot or a human
Previous
 
Next
New Post
6/5/2008 7:07 AM
 

Is there a definitive way to tell from the User-Agent whether a request is from a human or a search bot? In one of my modules I throw an error if a parameter is missing and this gets logged in the EventViewer. The problem is that the spiders are requesting these URLS and generating loads of errors - I would rather only log it if it was requested by a non-spider (ie. human). I was hoping for some reg-ex expression or am I going about this the wrong way? Apparently SolPart menu renders differently if it is a spider or a human - any idea what code they are using?


Thanks,
Rodney
Smart-Thinker - Social Networking modules for DotNetNuke
The DotNetNuke Directory - Are you listed?
PokerDIY - Example Implementation of DNN Social Network
Do use DNN a lot? Try the DotNetNuke Toolbar to save you time!
 
New Post
6/10/2008 8:29 PM
 

*bump*


Entrepreneur

PokerDIY Tournament Manager - PokerDIY Tournament Manager<
PokerDIY Game Finder - Mobile Apps powered by DNN
PokerDIY - Connecting Poker Players

 
New Post
6/10/2008 10:00 PM
 

It's not full-proof, but Request.Browser.Crawler is the way.


DotNetNuke Modules from Snapsis.com
 
New Post
6/11/2008 8:41 PM
 

Hehe - thanks for that John - I've done some googling and it seems fine for my purposes (there is no advantage to be gained in spoofing it)


Entrepreneur

PokerDIY Tournament Manager - PokerDIY Tournament Manager<
PokerDIY Game Finder - Mobile Apps powered by DNN
PokerDIY - Connecting Poker Players

 
New Post
6/16/2008 9:29 AM
 

I've been checking my logs and it seems as though the slurp agent did not adhere to the check:

UserAgent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)

 

will hade to look into this!


Entrepreneur

PokerDIY Tournament Manager - PokerDIY Tournament Manager<
PokerDIY Game Finder - Mobile Apps powered by DNN
PokerDIY - Connecting Poker Players

 
Previous
 
Next
HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...How to tell if a request is a search bot or a humanHow to tell if a request is a search bot or a human


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out