Is it just the first time you access the home page?  If so then the most likely cause is that the application is being restarted and everything has to be recompiled.  To speed this up remove any unused modules and thier respective DLLs from the server.  You can also use something to keep loading the 'keepalive.aspx' page which should keep the application live longer.  As you are on a dedicated server you could also tweak the application pool settings.

If it loads slowly everytime see if its just one page or all pages in the site.  If all pages check to see if you have a module that loads on every page which draws in info from an external source (eg RSS feed) and if you find one disable it to see if that is the problem. If there is no shared module turn on some performance counters on the server itself and see if that is causing it (ie the server isn't powerful enough).  If its just one page tha always loads slowly run the check above for a modules that grabs info from somewhere else.  If there isn't one start removing modules from the page to see which is the culprit (you can restore the removed ones by using the recyle bin)

HTH

Antony