I'd like to prevent robots from indexing pages on my Domino websites

We have a single Domino server that hosts two different websites: www.abcd.com.au & www.efgh.com.au.

This is easily accomplished with the use of separate “Internet Site” (and related rule) documents.

However, it has come to light that pages from one website can be accessed via the other site’s domain.

For example, I have a page - www.abcd.com.au/pages/welcome.html - that is part of the initial website.

However, you can just as easily access that same page via the URL: www.efgh.com.au/pages/welcome.html

There’s really no security issue with this happening, but I’d like to prevent it if possible.

It was raised as a result of a Google search, which leads me to understand the logic used by robots to index the sites.

Is there any way to segregate the sites so that pages in one domain are NOT regarded as part of the other?

I have researched the use of the “robots.txt” file, but there is so much content on each site (and it is changing) that I think the management of the text file may become a nightmare.

If anyone has some insight that they wouldn’t mind passing on, I’d sure appreciate it.

Cheers!

T.