The very next comment thread is about unreasonable load that web crawlers create. http://1997.webhistory.org/www.lists/www-talk.1993q3/0001.ht...

Great proposal from Nathan Torkington that search engines be called "Josie and the Pussycats". Somehow Larry and Sergey didn't get that memo.