Components, Scripts, Codes: C/C++ / Searching / Web Indexing

webbase V.13

webbase is an internet web crawler written in C and later ported to C++. It uses a MySQL database to store information about crawled URLs. It is...

By: Loic Dachary Homepage


Larbin 1.1.2002

Larbin is a web crawler (also called (web) robot, spider, scooter, etc). It is intended to fetch a large number of web pages to fill the database...

By: Sebastien Ailleret Homepage


harvest 1.7.2028

Harvest is a system to collect information and make them searchable using a web interface. Harvest can collect information on inter- and intranet...

By: Kang-Jin Lee Homepage