This is framework to peroform large scale log analysis using Esper CEP engine. The main purprose of this project is to research and understand capabilities of CEP platform in application to system log management and intrusion detection.
One of the applicable uses is to detect DDOS attacks using this engine. The sample netflow server is provided in scripts file.
We use Maven system for this project. So things should be easy:
mvn package
Once built is complete, you can grab the jar and run it as:
java -jar target/ceplog-1.0-SNAPSHOT.jar
You can start sending events with something like
curl "http://localhost:8084/sendevent?stream=SyslogEvent&date=20120505121212&src=xxxx&dst=yyyyy"
there is a sample event generation script in scripts/symevents.py
An implementation of netflow server to collect netflow data and send to the Esper engine: scripts/netflowd/
Produced events are stored in ElasticSearch index file.