Wolfman's Brother wrote:
> Borek wrote:
>> On Sun, 24 Jul 2005 19:45:22 +0200, ted <firstname.lastname@example.org>
>>> Disallow: /*.gif$
>> If I recall correctly wildcards are not allowed by the standard.
>> Check at www.robotstxt.org
> To be pedantic about it.. It's not that wildcards arent ALLOWED by the
> standard, but that they arent HANDLED by it. So a "*" is not illegal,
> but simply means the literal character "*" rather than some other
> special meaning.
> However .. Google's handling of robots.txt DOES include special meanings
> for wildcards, and in that sense is non-standard.
> http://www.lowth.com/rope - Scriptable packet match logic for IPCop and
> other linux-based firewalls.
Two common errors:
* Wildcards are _not_ supported: instead of 'Disallow: /tmp/*' just say
Roy S. Schestowitz