Products

Solutions

Resources

Partners

Community

Blog

About

QA

Ideas Test

New Community Website

Ordinarily, you'd be at the right spot, but we've recently launched a brand new community website... For the community, by the community.

Yay... Take Me to the Community!

Welcome to the DNN Community Forums, your preferred source of online community support for all things related to DNN.
In order to participate you must be a registered DNNizen

HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...DNN 4.8.4 Load Balance Web Farm PerformanceDNN 4.8.4 Load Balance Web Farm Performance
Previous
 
Next
New Post
7/14/2008 3:59 AM
 

Hello,

I am trying to take my development web farm configuration to a production web farm, and having terrible performance issues. I have 2 win2003 servers in dev connected to a dev sql 2005 server. They are sharing a directory on one of the dev web servers via UNC for the DNN file store. It's being load balanced by an F5 BigIP box. performance seems ok. Now i am trying to configure the Production web farm with the same application. So far i have

3 internal win2003 web servers Dual Dual core, 4gb ram

1 external DMZ win 2003 web server, same spec.

SQL 2005 cluster w/san storage

File Server cluster for DNN files w/san storage

F5 BigIP round robin load balancing

I dont see antivirus on these boxes yet. DNN runs, but slowly. watching perfmon i see spikes in Memory Pages/Sec in the 4-800 range on any page access to any web server. I am using an AD account to run the DNN app. Created an App pool using this account, set it to use 4 processes (web garden). I cant install modules as they just time out. Page refreshes take an extreme amount of time. The load page with no modules takes 5-8 seconds usually. The login screen takes 30+ seconds to load. I have run the MIcrosoft Windows 2003 Performance Advisor, under the IIS reports it says TCP/IP is using a process other than the expected IIS-related processes to send/recieve traffic. CPU load is very low, available memory is over 3 gigs, highest disk i/o is less than 100/sec. I have implemented the same security config in dev as in prod, same steps followed.

these numbers were from when i targetted one of the servers and bypassed the F5. I read that last file access update may be causing too much overhead for UNC shared web sites, so i turned it off. The Memory Pages/Sec seems to be lower but the site doesnt seem to perform any faster. I still cant get modules to install. I have turned on impersonation in the web.config and used the AD account DNN is running under. The DBA's say the db were connecting to isnt being stressed, its shared with other applications and pretty beefy.

The only other standout i see from the performance advisor is under HTTP Response Time Statistics "Customer ISAPI" has a response time of 10,124 (ms), I dont see any ISAPI filters listed for the web site in IIS MMC. I also dont see 404/500 errors, or any others from the web servers. I did see a blurb (an old one) that said the network service account needed access to the DNN root to check permissions, could this be an issue, as i am not using network service but an AD user for everything. I would expect a security error if this was the case.

Any guidance is greatly appreciated.

Thanks,

DDA

 

 
New Post
7/14/2008 9:33 AM
 

Hi,

NOTE: Please keep in mind that I've never set up a DNN instance load-balanced, but I have done plenty of other load-balanced ASP.NET applications.

Web Gardens - I tend to not use web gardens - just one instance per server - multiple web gardens can tend to canibilze the process and memory usage.  You don't really need them for most ASP.NET distributed applications, in my experience as each web server just does it's own thing and doesn't rely on the others.  I think that web gardens are mostly useful for really powerful machines - eg 8+CPU monsters.  There's lots of info on the web about them, dos and don'ts.

AD authentication - on W2003 you MUST give 'NETWORK SERVICE' access as per the install docs.  I think this is because the application pool is, by default, running under the 'NETWORK SERVICE' identity.

UNC shares - Don't know what you are doing with this - maybe so you don't have to duplicate resource files?  For most webserver installs I just duplicate files between the servers, maybe using a folderwatcher process so that they are both mirrored - you use more space, but IF ONE SERVER GOES DOWN you don't loose the entire website.

 

Do more profiling on the machine properties to find the bottleneck.  What does the ASP.NET tracing say?  The tracing should tell you what section of code is taking so long to execute.  Sometimes I've still been clueless after seeing the trace, so I end up putting a bunch of Trace statements inside the offending code to figure out what exact call is taking the time.  Then when you see it, it's usually obvious, and you have a d'oh moment!

Lance

 
New Post
7/14/2008 1:40 PM
 

Thanks for the info. I had configured the web garden as a possible solution, but it hasnt made any difference either way. Currently AD auth isnt being used, i couldnt get the module to install for DNN, it always times out. My applicaiton pool is configured to use the AD account that DNN uses. It's been given permissions to all the appropriate local system resources. I have never really trusted file mirroring/replication so the backend is a clustered file server, and set up as per guidance from MS.

thinking it might be security related to the file system, i gave everyone read access to the file store, hopefully if Network Service needs to query file permissions even if asp isnt using it that would help, it didnt seem to. I tried tracing last night but really wasnt getting much info from it. Maybe it was the hour, i'll look into it again.

 

 

Thanks again,

David

 
New Post
7/14/2008 2:34 PM
 

Are you having those issues in your dev environment? If not, what is different? I'm assuming that you have read the Webfarm documentation. Web gardens is not recommended by anyone to my knowledge, so start by ditching that.

 Try Sysinternals FileMon to see real time permissions problems.

 
Previous
 
Next
HomeHomeUsing DNN Platf...Using DNN Platf...Administration ...Administration ...DNN 4.8.4 Load Balance Web Farm PerformanceDNN 4.8.4 Load Balance Web Farm Performance


These Forums are dedicated to discussion of DNN Platform and Evoq Solutions.

For the benefit of the community and to protect the integrity of the ecosystem, please observe the following posting guidelines:

  1. No Advertising. This includes promotion of commercial and non-commercial products or services which are not directly related to DNN.
  2. No vendor trolling / poaching. If someone posts about a vendor issue, allow the vendor or other customers to respond. Any post that looks like trolling / poaching will be removed.
  3. Discussion or promotion of DNN Platform product releases under a different brand name are strictly prohibited.
  4. No Flaming or Trolling.
  5. No Profanity, Racism, or Prejudice.
  6. Site Moderators have the final word on approving / removing a thread or post or comment.
  7. English language posting only, please.
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out
What is Liquid Content?
Find Out