web crawling in perl

Roger Burton West roger at firedrake.org
Mon May 22 20:10:55 BST 2006


On Mon, May 22, 2006 at 07:37:55PM +0100, Sam Smith wrote:

>What do people think is the "best" perl (or possibly
>otherwise if it's much better) module/script for crawling
>remote websites?

I've tended to use WWW::Mechanize ever since a London.pm technical
meeting where it was mentioned... but yes, I'm rolling my own too.

R


More information about the london.pm mailing list