I use a host which allows Add On Domains. I can use my webspace to host more than one website. Here's an example of what I am trying to do.
The first site I hosted on my webspace was called 123.com
When I add on another domain (456.com) this is created as a subfolder in the root directory of 123.com
Both work fine. The urls would direct you to the correct pages. What I want to ensure is that you cannot access pages with a url 123.com/456
As "456" is a subfolder of "123" it must appear to search engines to be BOTH two separate sites and that their is a folder called "456" in the site 123.com
How can I ensure that a Search Engine which is spidering my website cannot see the path 123.com/456?
I know a robots.txt will help to guide the robot, but I am looking for a cast iron way to ENSURE that 123.com/456 is not accessible.
Hi, the only thing I can think of myself is if you make the 456 domain point to a 456 sub domain, so the 456 info would be found at something like http://456.123.com with the 456 domain pointing at this address.
LeonStacey.co.uk
April 2006
Automatic Answer
We may have found other answers which could help you.