Build a Web Spider on Linux

Posted by IdaAshley on Nov 15, 2006 4:49 AM EDT
IBM/developerWorks; By M. Tim Jones 		Mail this story
Print this story

Web spiders are software agents that traverse the Internet gathering, filtering, and potentially aggregating information for a user. This article shows you how to build spiders and scrapers for Linux to crawl a Web site and gather information, stock data, in this case. Using common scripting languages and their collection of Web modules, you can easily develop Web spiders.

Full Story

  Nav
» Read more about: Groups: IBM, Linux; Story Type: News Story

« Return to the newswire homepage

Subject Topic Starter Replies Views Last Post
whoo, Ruby cheshire137 0 729 Nov 15, 2006 6:33 AM

You cannot post until you login.