Hello,

I have a DNN installation with 2 parent portals, running under two totally different domains:

• AAA.com - production system
• BBB.com - for test purposes only.

I would like to make BBB.com to be disabled from Google bot.

What instructions shall I put into the robots.txt file? Is this problem requires the same robots.txt modification at all or I need an other one? If I need an other one where do I have to place it?

Thanks!

robots.txt should look like this:

User-agent: Google
Allow: /Products/Product1.aspx
Allow: /Products/Product2.aspx

Crawler puts the actual domain (which it monitoring) to the beginning of all rows, so the results will be like this:

AAA.com/Products/Product1.aspx 
AAA.com/Products/Product2.aspx

Problem: For the other Parent Portal (w domain BBB.com) these rows are irrelevant as BBB.com/Products/Product1.aspx  does not exist.

See the point?

A DNN instance w multiple portals should have multiple robots.txt files.
But it is not possible as both portals' root folder is the same.

Correct me if I'm wrong.