Все программы от Dustgem Co.,Ltd

Multi threads and distributed free web crawler, for both internet and interanet.You can control how frequency the spider should crawl your pages, you can save the pages locally or sent to a search-engine applicant.