Apache Kafka is an open source project for a distributed pub-sub messaging system designed as a distributed commit log. To make things simple, let’s view Kafka as a real time data store which is masquerading as a messaging system.
Kafka stores messages in topics that are partitioned and replicated across multiple brokers in a cluster. Producers send messages to topics from which consumers read.