kafka-connect-hdfs is a Kafka Connector for copying data between Kafka and Hadoop HDFS.
Documentation for this connector can be found here.
To build a development version you'll need a recent version of Kafka as well as a set of upstream Confluent projects, which you'll have to build from their appropriate snapshot branch. See the FAQ for guidance on this process.
You can build kafka-connect-hdfs with Maven using the standard lifecycle phases.
Refer frequently asked questions on Kafka Connect HDFS here - https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ
- Source Code: https://github.com/confluentinc/kafka-connect-hdfs
- Issue Tracker: https://github.com/confluentinc/kafka-connect-hdfs/issues
The project is licensed under the Apache 2 license.