Products

Evoq Content Overview Content Creation Workflow Asset Management Mobile Responsive Personalization Content Analytics SEO Integrations Security Website PerformanceEvoq Engage Overview Community Management  Dashboard  Analytics  Member Profile Gamification Advocate Marketing Community Engagement  Ideas  Answers  Discussions  Groups  Wikis  Events Mobile ReadyDNN Support PackagesEvoq: CMS FeaturesEvoq OnDemandCompare DNN's CMS Products

Solutions

Content Management SystemMulti-Channel PublishingDigital MarketingOnline Community ManagementIntranet Software SolutionOur CustomersPrime

Resources

Test DrivesSchedule A DemoDocumentation CenterWebinarsWhite PapersProduct ManualsRequest PricingData SheetsCase StudiesEvoq Preferred Products Content Management Ecommerce Forms Identity Management and Authentication Site Management Social Themes

Partners

DNN Partners Partner Directory Become a DNN Partner Partner Program Overview  Hosting  Implementation  ISV  Training  Competencies

Community

Participate Ask a Question Forums Community Showcase DNN MVP  Program Overview  Lifetime MVPs  Honorary MVPs Subscribe to DNN Digest Advisory Groups  Awareness Advisory Group  Developer Advisory Group  Partner Advisory Group  Technology Advisory GroupLearn Documentation Wiki Community Blog Video Library Project History Development RoadmapDownload DNN Store Language Packs Manuals Nightly BuildsSecurity Policies Security Center

Blog

About

News Press Releases News Coverage Press KitCareersContact DNN

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen
HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...Search Engin Bots killing my DNN portalsSearch Engin Bots killing my DNN portals
Previous
 
Next
New Post
10/18/2007 10:25 AM
 
Wolverine

Joined: 8/21/2006
Posts: 144

What's up all,
    Hopefully someone has come across this....The search engine bots that crawl my portals (about 20) are bringing them down (System.OutOfMemoryException) all of the time...not sure what the problem it...it is not ne bot either...yahoo, google, msn...etc...Also the blog "rovers" are doing it.

It happens at LEAST once a day (mid-night/10am/4pm).  Anyone know how to stop this, get around it?

Thanks very much in advance!
 
New Post
10/18/2007 11:47 PM
 
Tom Kraak


Joined: 12/26/2002
Posts: 458

Have you proved that theory by "closing the door" on the bots via robots.txt?

Tom Kraak
SEO Analyst
R2integrated
 
New Post
10/19/2007 8:49 AM
 
Wolverine

Joined: 8/21/2006
Posts: 144

No, I haven't put them into to the robot.txt file...But bots can get around that anyways (they are supposed to follow it, but there is no guarantee).

Otherwise the reason why I am thinking this is that when I go into the DNN log viewer to find what actually caused the "OutOfMemoryException" it is always a "bot" that is the first exception.

They are trying to crawl through pages that shouldn't even be grabbed...like the search results page...

I will add them to the robot.txt file and see what happens.
 
New Post
10/24/2007 9:56 AM
 
Allen Foster


Joined: 2/19/2004
Posts: 47

I'm curious, I am having a similar exception at intervals on several of my DNN sites, how can you tell that it was a bot that as visiting at the time of the exception?
 
New Post
10/24/2007 9:59 AM
 
Chris Hammond


Chris Hammond's Avatar

Chris Hammond's Avatar

Chris Hammond's Avatar

www.christoc.com
Joined: 1/14/2003
Posts: 7319

I'm not going to be all that helpful here, but I can try!

I seem to recall seeing someone else have this issue before, long ago though. I don't recall what the fix was, my sites all respond okay to spiders indexing them.

What version of DNN are you running?

Chris Hammond
Former DNN Corp Employee, MVP, Core Team Member, Trustee
Christoc.com Software Solutions DotNetNuke Module Development, Upgrades and consulting.
dnnCHAT.com a chat room for DotNetNuke discussions
 
 Page 1 of 2
12Next 
Previous
 
Next
HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...Search Engin Bots killing my DNN portalsSearch Engin Bots killing my DNN portals


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out