Wednesday, December 23, 2009

Where can I find tutorials or info on how to create a Web Crawler or similar bots?

I'm learning PHP and my goal is someday design cool web tools or services, and I'm very intrigued to find out how to design a Web Crawler or info on similar apps...Where can I find tutorials or info on how to create a Web Crawler or similar bots?
Wiki has a list of open source crawlers, these are a good place to start then you can modify them as needed: http://en.wikipedia.org/wiki/Web_crawler

No comments:

Post a Comment