Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...Spider troubleSpider trouble
Previous
 
Next
New Post
9/16/2008 3:57 PM
 

Anyone else seen IIS log entries like this before?

/url/tabid/109/url/tabid/108/url/tabid/153/url/tabid/109/url/tabid/109/url/tabid/153/url/tabid/109/url/tabid/109/default.aspx

IIS logs are getting ~100MB large, CPU goes up to 100% from time to time. This is obviously caused by "MS+Search+4.0+Robot"


Cheers,
Philipp Becker, Peppertree Solutions
 
New Post
9/16/2008 4:26 PM
 

I had something like that a few weeks ago......the bots eventually gave up.


-Mitchel Sellers
Microsoft MVP, ASPInsider, DNN MVP
CEO/Director of Development - IowaComputerGurus Inc.
LinkedIn Profile

Visit mitchelsellers.com for my mostly DNN Blog and support forum.

Visit IowaComputerGurus.com for free DNN Modules, DNN Performance Tips, DNN Consulting Quotes, and DNN Technical Support Services
 
New Post
9/16/2008 10:01 PM
 

Philipp - put the following two lines into your robots.txt file:

User-agent: MS Search 4.0 Robot
Disallow: /
See robots.txt on this site as an example. And this blog post sheds a bit more light on the issue.

Tom Kraak
SEO Analyst
R2integrated
 
New Post
9/17/2008 6:43 AM
 

Thanks a million guys, that really helped. The blog post from Scott was the thing I was looking for...


Cheers,
Philipp Becker, Peppertree Solutions
 
Previous
 
Next
HomeHomeOur CommunityOur CommunityGeneral Discuss...General Discuss...Spider troubleSpider trouble


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out