IBM Journey to AI blog

JANUARY 8, 2024

They often use Apache Kafka as an open technology and the de facto standard for accessing events from a various core systems and applications. They are able to combine event topics to identify patterns or aggregates to analyze trends and detect anomalies. This approach then enables them to build new responsive applications.

EDA 80

EDA Apache Kafka Clustering Data Governance 80

IBM Journey to AI blog

MARCH 14, 2024

Apache Kafka stands as a widely recognized open source event store and stream processing platform. One key advantage of opting for managed Kafka services is the delegation of responsibility for broker and operational metrics, allowing users to focus solely on metrics specific to applications.

Apache Kafka 92

Apache Kafka Data Pipeline 92

ODSC - Open Data Science

JULY 22, 2023

The week was filled with engaging sessions on top topics in data science, innovation in AI, and smiling faces that we haven’t seen in a while. We had bigger sessions on getting started with machine learning or SQL, up to advanced topics in NLP, and how to make deepfakes.

Apache Kafka 52

Apache Kafka Machine Learning Machine Learning Data Science 52

ODSC - Open Data Science

JUNE 1, 2023

We’re going to assume that the pizza service already captures orders in Apache Kafka and is also keeping a record of its customers and the products that they sell in MySQL. We can solve this problem using just the data in the orders topic. We also need to indicate which way this is trending.

Analytics 98

Analytics Analytics Apache Kafka Data Science 98

ODSC - Open Data Science

MAY 24, 2023

Streaming Machine Learning Without a Data Lake The combination of data streaming and ML enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 52

Data Lakes ML ML Analytics 52

The MLOps Blog

FEBRUARY 5, 2023

There are a number of tools that can help with streaming data collection and processing, some popular ones include: Apache Kafka : An open-source, distributed event streaming platform that can handle millions of events per second. sleep 10 Create Kafka topics – for training and testing data: ! kafka_2.13 -3.3.2 /bin/kafka-topics.sh

Machine Learning 73

Machine Learning Machine Learning Data Pipeline Apache Kafka 73

AWS Machine Learning Blog

NOVEMBER 3, 2023

m How it’s implemented In our quest to accurately determine shot speed during live matches, we’ve implemented a cutting-edge solution using Amazon Managed Streaming for Apache Kafka (Amazon MSK). These Lambda functions and Fargate containers then make this data available for further use in the appropriate MSK topics.

AWS 90

AWS Apache Kafka Data Scientist Algorithm 90

AWS Machine Learning Blog

MARCH 30, 2023

To ensure real-time updates of ball recovery times, we have implemented Amazon Managed Streaming for Apache Kafka (Amazon MSK) as a central solution for data streaming and messaging. Both the Lambda function and the Fargate container publish the data for further consumption in the relevant MSK topics.

AWS 72

AWS Machine Learning Machine Learning Apache Kafka 72

ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

IBM Journey to AI blog

NOVEMBER 9, 2023

Apache Kafka is a high-performance, highly scalable event streaming platform. To unlock Kafka’s full potential, you need to carefully consider the design of your application. It’s all too easy to write Kafka applications that perform poorly or eventually hit a scalability brick wall.

Apache Kafka 68

Apache Kafka Algorithm Clustering 68

Pickl AI

JULY 20, 2023

NLP techniques help extract insights, sentiment analysis, and topic modeling from text data. Real-time Data Stream Analysis: Use Python with libraries like Apache Kafka and Apache Spark to process and analyze real-time data streams from sources like Twitter, sensors, or website logs.

Analytics 40

Analytics Analytics Big Data Big Data 40

AWS Machine Learning Blog

APRIL 19, 2023

Streaming ingestion – An Amazon Kinesis Data Analytics for Apache Flink application backed by Apache Kafka topics in Amazon Managed Streaming for Apache Kafka (MSK) (Amazon MSK) calculates aggregated features from a transaction stream, and an AWS Lambda function updates the online feature store.

ML 77

ML ML Apache Kafka SQL 77

The Data Administration Newsletter

FEBRUARY 15, 2022

Most large technology businesses collect data from their consumers in a variety of methods, and the majority of the time, this data is in its raw form. However, when data is presented in an understandable and accessible style, it may assist and drive business requirements. The task is to process the data and, if required, […].

Apache Kafka 52

Apache Kafka Big Data Big Data Business Intelligence 52

Mlearning.ai

MAY 16, 2023

The events can be published to a message broker such as Apache Kafka or Google Cloud Pub/Sub. The serving layer would then present the combined data in a dashboard or report, including information on how many people are talking about a particular topic, how they are talking about it, and where they are located.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52