comments Discuss   addto Add this link to...  recommend Tell a friend   report Bury
Category:                                     Crawlers / Spiders / Bots
Supported Platforms:               comments   Windows   comments  Linux   
License Type:                            comments  Open Source
License Cost:                             free
License:                                       GNU GPL v2.0
Associated file extensions:     e-mail, PDF, HTML, XML, gzip, doc, xls, ppt, gz, ps
Development Environment:     C, Perl
Alternative Products List:       ht://dig,DataparkSearch, HTTrack, JSpider, Larbin, Webtools4larbin, Methabot, Nutch, ScrapBook, WebVac, WebSPHINX, WIRE, LWP::RobotUA, Web Crawler, Sherlock Holmes, Ruya, Universal Information Crawler, Agent Kernel , Squzer, Heritrix Web Crawler, YaCY
Swish-e is a fast, flexible, and free open source system for indexing collectio read more »

comments Discuss   addto Add this link to...  recommend Tell a friend   report Bury
Category:                                     Crawlers / Spiders / Bots
Supported Platforms:               comments   Windows   comments  Linux    comments  Mac
License Type:                            comments  Open Source
License Cost:                             free
License:                                       GNU GPL v2.0
Binaries available?:                   No
Is it a service?:                           Yes
Alternative Products List:       ht://dig, DataparkSearch, HTTrack, JSpider, Larbin, Webtools4larbin, Methabot, Nutch, ScrapBook, WebVac, WebSPHINX, WIRE, LWP::RobotUA, Web Crawler, Sherlock Holmes, Ruya, Universal Information Crawler, Agent Kernel , Squzer, Heritrix Web Crawler
YaCy is a scalable personal web crawler and web search engine. One YaCy install read more »

comments Discuss   addto Add this link to...  recommend Tell a friend   report Bury
Category:                                     Crawlers / Spiders / Bots
Supported Platforms:               comments   Windows   comments  Linux    comments  Mac
License Type:                            comments  Open Source
License Cost:                             free
License:                                       GPLv2
Binaries available?:                   No
Is it a service?:                           No
Alternative Products List:       ht://dig, DataparkSearch, HTTrack, JSpider, Larbin, Webtools4larbin, Methabot, Nutch, ScrapBook, WebVac, WebSPHINX, WIRE, LWP::RobotUA, Web Crawler, Sherlock Holmes, Ruya, Universal Information Crawler, Agent Kernel , Squzer, Heritrix Web Crawler, Yacy
GNU Wget is a free software package for retrieving files using HTTP, HTTPS and FTP, the most widely-used Internet protocols. It is a non-interactive read more »