Andre Lewis
Archive
/
RSS
February 13
Amazon Web Services Developer Connection : Using Amazon S3, EC2, SQS, Lucene, and Ruby for Web Spidering
Nice article on using ec2 to spider and index sites. Also uses Hpricot, solr.