__/ [ dingbat@xxxxxxxxxxxxxx ] on Friday 28 April 2006 13:32 \__
> Brian Cryer wrote:
>
>> is generally considered better etiquette to not have a robots.txt file or
>> to have an empty one?
>
> Have one - keeps the 404s down for simpler logs (same with
> favicon.ico)
Precisely. This should make no difference according to what I once read.
There is also a file called siteinfo.xml (if I recall the name correctly),
which is Alexa-specific. I can also think of requests that assume a Windows
servers and raise 404's. All these additional files tend to contribute to
clutter, so they are better redirected away or served as empty files.
Best wishes,
Roy
--
Roy S. Schestowitz | Useless fact: Sharks are immune to cancer
http://Schestowitz.com | SuSE Linux ¦ PGP-Key: 0x74572E8E
2:05pm up 21:10, 13 users, load average: 0.34, 0.41, 0.44
http://iuron.com - Open Source knowledge engine project
|
|
