IBM Journey to AI blog

SEPTEMBER 4, 2024

Apache Kafka is an open-source , distributed streaming platform that allows developers to build real-time, event-driven applications. With Apache Kafka, developers can build applications that continuously use streaming data records and deliver real-time experiences to users. How does Apache Kafka work?

Apache Kafka 58

Apache Kafka Internet of Things Data Pipeline Clustering 58

ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

Data Science Dojo

JULY 24, 2023

In the next sections of this blog, we will delve deeper into the technical aspects of Distributed Systems in Big Data Engineering, showcasing code snippets to illustrate how these systems work in practice.

Big Data 195

Big Data Big Data Data Engineering Data Engineering 195

Pickl AI

JULY 30, 2024

This blog delves into the fundamentals of Apache NiFi, its architecture, and how it can leverage for effective data flow management. What is Apache NiFi? Apache NiFi is a robust data integration tool that facilitates the automation of data flows between different systems.

ETL 52

ETL Data Lakes Big Data Big Data 52

The MLOps Blog

FEBRUARY 5, 2023

There are a number of tools that can help with streaming data collection and processing, some popular ones include: Apache Kafka : An open-source, distributed event streaming platform that can handle millions of events per second. It can be used to collect, store, and process streaming data in real-time.

Machine Learning 72

Machine Learning Machine Learning Data Pipeline Apache Kafka 72

AWS Machine Learning Blog

APRIL 18, 2025

Think of the examples of clickstream data, credit card swipes, Internet of Things (IoT) sensor data, log analysis and commodity priceswhere both current data and historical trends are important to make a learned decision. In this step, you follow the detailed instructions that are mentioned at Create a topic in the Amazon MSK cluster.

Apache Kafka 94

Apache Kafka AWS Clustering Database 94