IBM Journey to AI blog

SEPTEMBER 4, 2024

Apache Kafka is an open-source , distributed streaming platform that allows developers to build real-time, event-driven applications. With Apache Kafka, developers can build applications that continuously use streaming data records and deliver real-time experiences to users. How does Apache Kafka work?

Apache Kafka 58

Apache Kafka Internet of Things Data Pipeline Clustering 58

ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

Pickl AI

JULY 24, 2023

Real-Time Data Ingestion Examples Here are some examples of real-time data ingestion applications: Internet of Things (IoT) Devices: IoT devices generate a vast amount of data, such as temperature, humidity, location, and sensor readings.

Internet of Things 52

Internet of Things Apache Kafka ETL Azure 52

Pickl AI

DECEMBER 2, 2024

Internet of Things (IoT): Devices such as sensors, smart appliances, and wearables continuously collect and transmit data. Cloud Storage: Services like Amazon S3, Google Cloud Storage, and Microsoft Azure Blob Storage provide scalable storage solutions that can accommodate massive datasets with ease.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52

Pickl AI

NOVEMBER 25, 2024

Internet of Things (IoT): Devices such as sensors, smart appliances, and wearables continuously collect and transmit data. Cloud Storage: Services like Amazon S3, Google Cloud Storage, and Microsoft Azure Blob Storage provide scalable storage solutions that can accommodate massive datasets with ease.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52

The MLOps Blog

FEBRUARY 5, 2023

There are a number of tools that can help with streaming data collection and processing, some popular ones include: Apache Kafka : An open-source, distributed event streaming platform that can handle millions of events per second. Azure Stream Analytics : A cloud-based service that can be used to process streaming data in real-time.

Machine Learning 72

Machine Learning Machine Learning Data Pipeline Apache Kafka 72