Re: web snapshot

From: Eugene.Leitl@lrz.uni-muenchen.de
Date: Thu Jan 04 2001 - 12:26:03 MST


"Michael M. Butler" wrote:

> I can imagine something like a consensual benign virus infecting most
> HTTPDs (but not all--there's no room in a Java-aware oven mitt for the
> extra code)--and poring over their filesystems and reporting what was
> found. I don't think the odds of that happening soon are high. But
> whaddaIknow?

I'm actually quite surprised that so far no one has integrated
webglimpse or http://www.htdig.org/ into http://www.apache.org/
default distribution. An index.bin RFC similiar to
http://info.webcrawler.com/mak/projects/robots/norobots-rfc.txt
needs to be drafted.



This archive was generated by hypermail 2b30 : Mon May 28 2001 - 09:56:16 MDT