We have upgraded our Google Mini appliance to the latest version 5.0.4 and are using it to crawl many of our DNN(v 4.5) sites. Recently, we made our sites multi-lingual and multi-regional also.Hence as opposed to our earlier URL, say www.abc.com, we have now www.abc.com/US as well as www.abc.com/US/Home/126/L/en-US/Default.aspx and www.abc.com/US/Home/126/L/de-DE/Default.aspx. Similarly we also have scenarios where we have abc.def.com/UK/Home/126/L/en-US/Default.aspx and abc.def.com/UK/Home/126/L/de-DE/Default.aspx; both these pages are logically the same but they contain data in different languages and have been given unique URLs so that Google Mini can crawl them(after identifying them as different pages). But we noticed that Google Mini isnt crawling these sites as expected. In the scenario where we have "abc.def.com/UK", "abc.def.com/UK/Home/126/L/en-US/Default.aspx" and "abc.def.com/UK/Home/126/L/de-DE/Default.aspx", it just crawls abc.def.com and excludes the rest of the URLs. We have put in the URL patterns ("http://abc.def.com/UK", "http://abc.def.com/UK/Home/126/L/en-US/Default.aspx" and "http://abc.def.com/UK/Home/126/L/de-DE/Default.aspx") in the following sections - Crawl URLs ("Start Crawling from the Following URLs" and "Follow and Crawl Only URLs with the Following Patterns"), Freshness Tuning ("Crawl Frequently", "Always Force Recrawl" and "Recrawl these URL Patterns ") and in the collection defined for those sites. But it has been noticed that most of the URLs are being excluded and the crawl status has been given as "Info:Redirected URL" or in some cases "Excluded: Long Redirect chain." (There are no retrieval errors though.)

Can someone throw some light on this? If anyone has already faced such an issue and has a solution for it, please do send it asap.

Thanks in advance.