Products

Evoq Content Overview Content Creation Workflow Asset Management Mobile Responsive Personalization Content Analytics SEO Integrations Security Website PerformanceEvoq Engage Overview Community Management  Dashboard  Analytics  Member Profile Gamification Advocate Marketing Community Engagement  Ideas  Answers  Discussions  Groups  Wikis  Events Mobile ReadyDNN Support PackagesEvoq: CMS FeaturesEvoq OnDemandCompare DNN's CMS Products

Solutions

Content Management SystemMulti-Channel PublishingDigital MarketingOnline Community ManagementIntranet Software SolutionOur CustomersPrime

Resources

Test DrivesSchedule A DemoDocumentation CenterWebinarsWhite PapersProduct ManualsRequest PricingData SheetsCase StudiesEvoq Preferred Products Content Management Ecommerce Forms Identity Management and Authentication Site Management Social Themes

Partners

DNN Partners Partner Directory Become a DNN Partner Partner Program Overview  Hosting  Implementation  ISV  Training  Competencies

Community

Participate Ask a Question Forums Community Showcase DNN MVP  Program Overview  Lifetime MVPs  Honorary MVPs Subscribe to DNN Digest Advisory Groups  Awareness Advisory Group  Developer Advisory Group  Partner Advisory Group  Technology Advisory GroupLearn Documentation Wiki Community Blog Video Library Project History Development RoadmapDownload DNN Store Language Packs Manuals Nightly BuildsSecurity Policies Security Center

Blog

About

News Press Releases News Coverage Press KitCareersContact DNN

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen
HomeHomeGetting StartedGetting StartedInstalling DNN ...Installing DNN ...4.9.4, crawler, Value cannot be null errors4.9.4, crawler, Value cannot be null errors
Previous
 
Next
New Post
7/1/2009 3:25 AM
 
Rodney Joyce


www.pokerdiy.com
Joined: 4/28/2004
Posts: 2796

Oliver Hine wrote

I've also posted the file in my downloads section quite a few months ago just incase anyone else was interested...

Oliver, how do you install this - do you just create a new folder off the root called "App_Browser" (I am on DNN 4.9.4) and throw it in there? Anything else?

Entrepreneur

PokerDIY Tournament Manager - PokerDIY Tournament Manager<
PokerDIY Game Finder - Mobile Apps powered by DNN
PokerDIY - Connecting Poker Players
 
New Post
7/1/2009 11:21 PM
 
Oliver Hine


Oliver Hine's Avatar

Oliver Hine's Avatar

Oliver Hine's Avatar

www.nbrane.com
Joined: 7/2/2003
Posts: 559

Hi Rodney, Sorry for the delayed response. I've been away all day on a road trip.

Anyways, for installation you just exact my zip package into the root of your DNN site. It should create the folder 'App_Browsers' with the file 'OtherSpiders.browser' inside. You might need to include the 'OceanSpiders.browser' file from the DNN5 package, I forget at the moment if I'm inheriting the base bot defination or the oceanspider version.

Either way, let me know how it works out and if it reduces/solves the errors you're having. If you still have problems, feel free to contact me!
 
New Post
7/2/2009 7:42 PM
 
Rodney Joyce


www.pokerdiy.com
Joined: 4/28/2004
Posts: 2796

No problem - I have copied the DNN 5.1 browser files as well as yours.

A day later and I am still getting a lot of errors thoug from these types of bots:

UserAgent: Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html)

UserAgent: SAMSUNG-SGH-E250/1.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/6.2.3.3.c.1.101 (GUI) MMP/2.0 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)

UserAgent: MSR-ISRCCrawler

UserAgent: Sosospider+(+http://help.soso.com/webspider.htm)

and loads more.

I am still completely ignorant as to the severity of this issue - is it causing me lost SEO? Is it a Major issue as Gemini suggests? Is it worth upgrading to DNN5.x soley for this bug? I really wish the core team would answer this.

 

Entrepreneur

PokerDIY Tournament Manager - PokerDIY Tournament Manager<
PokerDIY Game Finder - Mobile Apps powered by DNN
PokerDIY - Connecting Poker Players
 
New Post
7/2/2009 8:28 PM
 
Oliver Hine


Oliver Hine's Avatar

Oliver Hine's Avatar

Oliver Hine's Avatar

www.nbrane.com
Joined: 7/2/2003
Posts: 559

I'd load up a useragent switcher plugin for firefox, and test your site against those browser agents headers. You'll see exactly what the site looks like as those bots. For my sites when I upgraded to 5.0.0/1, the googlebot couldn't crawl the sites because the nav provider couldn't determine the version number of the browser, that's what caused me to take a closer look at my exceptions and hack together that browser file for the 5.0.0 and 5.0.1 releases. You'd think if the version couldn't be determined, it would have a fallback mode instead of just crashing the provider and causing the menu not to get rendered.

I've only encountered the Twiceler bot exception on my 5.1 site and haven't been bothered to add my browser cap fix yet, I think I need to diff the 5.0.0 and 5.1.0 cap files to see what was updated between release. After I finish up my current project, I'll see about hacking up the nav provider to try and eliminate this error once and for all...
 
New Post
7/3/2009 12:48 AM
 
Rodney Joyce


www.pokerdiy.com
Joined: 4/28/2004
Posts: 2796

Ah ok, I am beginning to understand the problem a bit better. The bad news is that by using one of those UserAgents an error is rendered with nothing else at all on the page - which means this is a pretty major issue on DNN 4.x and could badly afffect SEO and rankings if I have understood it correctly.

I wonder why your OtherSpiders.browser did not match the UserAgent for ia_archiver or Twiceler - both of those are in there but they are still throwing errors. Any suggestions on how to tell if your Browser files are being used by the application correctly?

Entrepreneur

PokerDIY Tournament Manager - PokerDIY Tournament Manager<
PokerDIY Game Finder - Mobile Apps powered by DNN
PokerDIY - Connecting Poker Players
 
 Page 4 of 9
Previous12345...9Next 
Previous
 
Next
HomeHomeGetting StartedGetting StartedInstalling DNN ...Installing DNN ...4.9.4, crawler, Value cannot be null errors4.9.4, crawler, Value cannot be null errors


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out