GitHub - matteoredaelli/ebot: Ebot, an Opensource Web Crawler built on top of a nosql database (apache couchdb, riak), AMQP database (rabbitmq), webmachine and mochiweb. Ebot is written in Erlang and it is a very scalable, distribuited and highly configurable web cawler. See wiki pages for more details

matteoredaelli / ebot Public

Notifications You must be signed in to change notification settings
Fork 55
Star 330

Ebot, an Opensource Web Crawler built on top of a nosql database (apache couchdb, riak), AMQP database (rabbitmq), webmachine and mochiweb. Ebot is written in Erlang and it is a very scalable, distribuited and highly configurable web cawler. See wiki pages for more details

www.redaelli.org/matteo-blog/projects/ebot

GPL-3.0 license

330 stars 55 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 237 Commits
deps		deps
doc		doc
ebin		ebin
priv		priv
src		src
utils		utils
.gitignore		.gitignore
Emakefile		Emakefile
LICENSE.txt		LICENSE.txt
Makefile		Makefile
README		README
start-dev.sh		start-dev.sh
start.sh		start.sh
sys.config		sys.config

Repository files navigation

EBOT (http://www.redaelli.org/matteo-blog/projects/ebot/)
USAGE: see the wiki homepage (http://wiki.github.com/matteoredaelli/ebot/) and ebot_test.erl for details
LICENSE: GPL v3+, see file LICENSE
Copyright (c) 2010, 2011 - Matteo Redaelli at libero dot it

Tested with Linux (Ubuntu and Debian) and Erlang R13B03 and R14A

*******************************************************************************
* DOWNLOAD "TAG" releases and not the latest sources that could be unstable...
*******************************************************************************