AWS Machine Learning Blog

APRIL 18, 2025

Retrieval Augmented Generation (RAG) enhances AI responses by combining the generative AI models capabilities with information from external data sources, rather than relying solely on the models built-in knowledge. The solution enables real-time analysis of customer feedback through vector embeddings and large language models (LLMs).

Apache Kafka 95

Apache Kafka AWS Clustering Database 95

IBM Journey to AI blog

SEPTEMBER 4, 2024

Apache Kafka is an open-source , distributed streaming platform that allows developers to build real-time, event-driven applications. With Apache Kafka, developers can build applications that continuously use streaming data records and deliver real-time experiences to users. How does Apache Kafka work?

Apache Kafka 58

Apache Kafka Internet of Things Data Pipeline Clustering 58

ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

Pickl AI

JULY 24, 2023

Real-Time Data Ingestion Examples Here are some examples of real-time data ingestion applications: Internet of Things (IoT) Devices: IoT devices generate a vast amount of data, such as temperature, humidity, location, and sensor readings. The post A Simple Guide to Real-Time Data Ingestion appeared first on Pickl AI.

Internet of Things 52

Internet of Things Apache Kafka ETL Azure 52

Pickl AI

DECEMBER 2, 2024

Internet of Things (IoT): Devices such as sensors, smart appliances, and wearables continuously collect and transmit data. They can be categorised into several types.These diverse sources contribute to the volume, variety, and velocity of data that organisations must manage.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52

Pickl AI

NOVEMBER 25, 2024

Internet of Things (IoT): Devices such as sensors, smart appliances, and wearables continuously collect and transmit data. They can be categorised into several types.These diverse sources contribute to the volume, variety, and velocity of data that organisations must manage.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52

Pickl AI

JULY 30, 2024

ETL (Extract, Transform, Load) Processes Apache NiFi can streamline ETL processes by extracting data from multiple sources, transforming it into the desired format, and loading it into target systems such as data warehouses or databases. Its visual interface allows users to design complex ETL workflows with ease.

ETL 52

ETL Data Lakes Big Data Big Data 52