-
Notifications
You must be signed in to change notification settings - Fork 32
Home
When you have a complex system architecture with a huge variety of services, the first question that arises is: "What happens when I start to generate tons of events and what is the behaviour of the system when it starts to process them?". For these reasons we are devoloping a high configurable and scalable tool called Khermes that can answer this "a priori simple" question.
"Khermes is a distributed fake data generator used in distributed environments that produces a high volume of events in a scalable way".
History of Khermes
Khermes evolved out of the Stratio platform need of producing data to show and test the different components of the platform. To do so the Stratio team created a pretty simple data generator called fakenator in 2015. In 2016 the tool evolve and mature and many teams within Stratio used it. In 2017 with the irruption of distributed systems within Stratio the team decided to created a distributed data generator that will allow the users to define data on-the-fly and produce it in a distributed way. This has resulted in a much more powerful data generation tool.
Khermes is designed to do the following:
- Generate user-defined random data (through twirl templates) and produce it to a kakfa cluster
- Run within a distributed environment that will allow Khermes to scale and increase the data generation load
- Allow the user to interact easily with the khermes cluster through a web console
If you want to find out more about the khermes architecture, check out the Architecture section.
We recommend to check out the Getting started section to find out how to start generating random data using khermes.
Khermes - An open source distributed data generator