webbase-5.17 is available 10 September 2001

Link The home_re table map domain names to regular expressions that extract the unique server name. Rules for large free hosting sites need this. Signal handling so that the crawl of a URL is never interrupted. The exploration will stop after or before loading a URL only. -noheuristics works with -touch to force loading even if the content of the URL is in the database. Fix index updating bug that removed documents from the index when they are found Not Modified by the crawler. Upgrade md5 code to GPL and other small utilities fix. Purge unused test data.