Kafka is an open-source distributed event streaming platform. It allows information streams to be processed to give more refined output and monitoring possibilities. Scalability is an important feature of Kafka, making this a powerful tool for large companies, such as LinkedIn (where it originated), AirBnB and many more.
In this blog we take a look at the development of Kafka and its infrastructure. Focusing on the changes that happened from 2017 until now, based on an earlier report from desosa.
The main advantages of kafka are:
- The high scalability due to its distributed architecture using capabilities like replication and partitioning.
- The high durability due to kafka persisting the messages on the disks.
- The high concurrency, kafka is able to handle thousands of messages per second and that too in low latency conditions
- The high reliability, kafka is able to support multiple subscribers. And in the event of failure automatically balances consumers.
A developer mostly focused on back-end frameworks in web development and tooling for ease of use for end users. Has a passion for architecture and design patterns.
I’m currently a MSc Computer Science Student at the TUDelft with my main areas of interest in distributed systems, storage tech, and operating systems.
KAFKA-12420: Kafka network Selector class has many constructors; use a Builder pattern instead
A rebuild of the Network/Selection class which replaces the current constructor with a builder pattern to replace the 6 present constructors