Skip to content

Logstash compatible feeder (multi-redis to Elasticsearch). Tailored for our usage at fotopedia

License

Notifications You must be signed in to change notification settings

fotonauts/leafheap

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LeafHeap

Logstash compatible feeder (redis to Elasticsearch). Tailored for our usage at fotopedia.

It was born after we found out about Kibana and wanted a more ligthweight approach than using Logstash. It's a followup of logstash_light and logstash_benchmark (in this benchmark the current implementation reads 12000 events/second on [email protected]).

This specific implementation reads one or several redis lists and injects them in an ElasticSearch. LeafHeap runs forever and barely complains.

Build

The build system uses sbt.

./sbt assembly

Building

Assuming you have a working Java 1.7 setup:

./sbt assembly

Usage

java -jar target/scala-2.10/LeafHeap-assembly-0.1-SNAPSHOT.jar --help
 --help        : Print help
 --logback VAL : overrides -d
 -d            : run with debug logging parameters
 -e VAL        : ElasticSearch HTTP Url
 -l VAL        : Redis Queues, comma separated list
 -p N          : Redis port
 -r VAL        : Redis hostname
java -jar LeafHeap-assembly-0.1-SNAPSHOT.jar \
 -e http://es.server.internal:9201/ \
 -l master,staging,testing \
 -r redis.server.internal

Credits

From Fotonauts:

  • Pierre Baillet @octplane.
  • kali

Copyright (c) 2013 Fotonauts released under the MIT license

About

Logstash compatible feeder (multi-redis to Elasticsearch). Tailored for our usage at fotopedia

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published