|
LexstwebSpider
Multi threads and distributed free web crawler, for both internet and interanet.You can control how frequency the spider should crawl your pages, you can save the pages locally or sent to a search-engine applicant. Ключевые слова:
crawler, spider
Скачать бесплатно! (535 Kb)
|
