Internet Agents: Spiders, Wanderers, Brokers, and 'Bots

One of the most dreaded questions in Usenet newsgroups devoted to the World Wide Web, programming, or MUDs is "How do I write a 'bot, DooD?" Well, now that Cheong has written Internet Agents, anyone can curl up with their terminal, a bottle of Jolt, and the Internet, and roll out their own. Although much of this information is available on the net, Cheong does a good job of pulling together the heretofore scattered and sometime occult arcana of arachnology and botology. Includes sample code for WebWalker, a Web maintenance robot, and WebShopper, a personal comparison shopping program.