article thumbnail

How to Build a Scalable Data Architecture with Apache Kafka

KDnuggets

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

article thumbnail

Apache Kafka and Apache Flink: An open-source match made in heaven

IBM Journey to AI blog

Apache Kafka and Apache Flink working together Anyone who is familiar with the stream processing ecosystem is familiar with Apache Kafka: the de-facto enterprise standard for open-source event streaming. With Apache Kafka, you get a raw stream of events from everything that is happening within your business.

article thumbnail

Build a Scalable Data Pipeline with Apache Kafka

Analytics Vidhya

Introduction Apache Kafka is a framework for dealing with many real-time data streams in a way that is spread out. It was made on LinkedIn and shared with the public in 2011.

article thumbnail

A Detailed Guide of Interview Questions on Apache Kafka

Analytics Vidhya

Introduction Apache Kafka is an open-source publish-subscribe messaging application initially developed by LinkedIn in early 2011. It is a famous Scala-coded data processing tool that offers low latency, extensive throughput, and a unified platform to handle the data in real-time.

article thumbnail

Apache Kafka Architecture and Use Cases Explained

Analytics Vidhya

That’s why you need to know about Apache Kafka, a publish-subscribe messaging system you can use to build distributed applications. The post Apache Kafka Architecture and Use Cases Explained appeared first on Analytics Vidhya. It is scalable and fault-tolerant, making […].

article thumbnail

Apache Kafka Use Cases and Installation Guide

Analytics Vidhya

The post Apache Kafka Use Cases and Installation Guide appeared first on Analytics Vidhya. As applications cover more aspects of our daily lives, it is increasingly difficult to provide users with a quick response. Source: kafka.apache.org Caching is used to solve […].

article thumbnail

Exploring Partitions and Consumer Groups in Apache Kafka

Analytics Vidhya

Introduction Earlier, I had introduced basic concepts of Apache Kafka in my blog on Analytics Vidhya(link is available under references). This article introduced concepts involved in Apache Kafka and further built the understanding by using the python API of Kafka to write some […].