Home Messages Index
[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index

Re: Robots.txt Special orders

Roy Schestowitz wrote:

> I will assume that your subdirectory /subdir_bianca/ has not been crawled
> and indexed. I will also assume that you want to encourage search engines
> to enter to /subdir_bianca/ by changing robots.txt.

I think he wants just the opposite: He does not want
http://www.alex.de/subdir_bianca/* to be crawled, he wants
http://www.bianca.de/ to be crawled, which has the same content since it
actually is the same files. He just doesn't want anybody to see that
bianca.de has anything to do with alex.de.

@Alex: Do you know de.comm.infosystems.suchmaschinen? Essentially the same
as here, but in German and less traffic.

Marc

-- 
http://low.audioattack.de
http://yacy.audioattack.de

[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index