KDnuggets

APRIL 5, 2023

Learn about Apache Kafka architecture and its implementation using a real-world use case of a taxi booking app.

Apache Kafka 269

Apache Kafka Data Engineer Data Engineering Data Engineering 269

Analytics Vidhya

NOVEMBER 2, 2020

Overview Learn about viewing data as streams of immutable events in contrast to mutable containers Understand how Apache Kafka captures real-time data through event. The post Apache Kafka: A Metaphorical Introduction to Event Streaming for Data Scientists and Data Engineers appeared first on Analytics Vidhya.

Apache Kafka 291

Apache Kafka Data Scientist Data Engineering Data Engineer 291

IBM Journey to AI blog

FEBRUARY 12, 2024

At the forefront of this event-driven revolution is Apache Kafka, the widely recognized and dominant open-source technology for event streaming. While most enterprises have already recognized how Apache Kafka provides a strong foundation for EDA, they often fall behind in unlocking its true potential.

Apache Kafka 113

Apache Kafka EDA SQL Database 113

Hacker News

FEBRUARY 5, 2024

A desktop client for Apache Kafka. Contribute to Bogdanp/Franz development by creating an account on GitHub.

Apache Kafka 102

Apache Kafka 102

databricks

AUGUST 12, 2024

The blog explores data streams from NASA satellites using Apache Kafka and Databricks. It demonstrates ingestion and transformation with Delta Live Tables in SQL and AI/BI-powered analysis of supernova events.

Apache Kafka 254

Apache Kafka SQL AI AI 254

IBM Journey to AI blog

NOVEMBER 3, 2023

Apache Kafka and Apache Flink working together Anyone who is familiar with the stream processing ecosystem is familiar with Apache Kafka: the de-facto enterprise standard for open-source event streaming. With Apache Kafka, you get a raw stream of events from everything that is happening within your business.

Apache Kafka 80

Apache Kafka Data Warehouse Data Pipeline Big Data 80

Analytics Vidhya

JULY 12, 2023

Best Big Data Softwares - Apache Hadoop, Apache Spark, apache Kafka, Apache Storm, Apache Cassandra, Apache Hive, zoho & more.

Apache Kafka 260

Apache Kafka Apache Hadoop Big Data Big Data 260

Hacker News

FEBRUARY 8, 2023

Learn what windowing is, the difference between the four types of windows (hopping and tumbling, or session and sliding), and how to create them.

Apache Kafka 171

Apache Kafka 171

Dataconomy

MAY 26, 2017

The post Amazon Kinesis vs. Apache Kafka For Big Data Analysis appeared first on Dataconomy. Data processing today is done in form of pipelines which include various steps like aggregation, sanitization, filtering and finally generating insights by applying various statistical models. Parts of the Kinesis platform are.

Apache Kafka 155

Apache Kafka Data Analysis Data Analysis Big Data 155

Hacker News

AUGUST 30, 2024

This is a guest article by Stanislav Kozlovski, an Apache Kafka Committer. If you would like to connect with Stanislav, you can do so on Twitter and LinkedIn. AWS S3 is a service every engineer is familiar with. It’s the service that popularized the notion of cold-storage to the

Apache Kafka 144

Apache Kafka AWS 144

Analytics Vidhya

SEPTEMBER 22, 2022

Dale Carnegie” Apache Kafka is a Software Framework for storing, reading, and analyzing streaming data. This article was published as a part of the Data Science Blogathon. Introduction “Learning is an active process. We learn by doing. Only knowledge that is used sticks in your mind.-

Data Pipeline 269

Data Pipeline Apache Kafka Internet of Things Data Science 269

KDnuggets

APRIL 12, 2023

How to Build a Scalable Data Architecture with Apache Kafka Top 19 Skills You Need to Know in 2023 to Be a Data Scientist • 8 Open-Source Alternative to ChatGPT and Bard • Free eBook: 10 Practical Python Programming Tricks • DataLang: A New Programming Language for Data Scientists… Created by ChatGPT? •

Apache Kafka 211

Apache Kafka Data Scientist Python 211

Hacker News

OCTOBER 22, 2023

The choice between OpenTelemetry Collector and Apache Kafka isn't a zero-sum game. Each has its unique strengths and can even complement each other in certain architectures.

Apache Kafka 178

Apache Kafka Data Quality 178

Hacker News

APRIL 7, 2024

A cloud native implementation for Apache Kafka, reducing your cloud infrastructure bill by up to 90%. AutoMQ/automq

Apache Kafka 131

Apache Kafka 131

Dataconomy

JULY 29, 2024

Talks and insights Mikhail Epikhin: Navigating the processor landscape for Apache Kafka Mikhail Epikhin began the session by sharing his team’s research on optimizing Managed Service for Apache Kafka. His presentation focused on the performance and efficiency of different instance types and processor architectures.

Apache Kafka 91

Apache Kafka Data Pipeline Data Warehouse ETL 91

Hacker News

DECEMBER 18, 2023

Securely interface web apps, IoT clients, and microservices to Apache Kafka® via declaratively defined, stateless APIs. Securely interface web apps, IoT clients, and microservices to Apache Kafka® via declaratively defined, stateless APIs. A multi-protocol, event-native proxy. GitHub - aklivity/zilla: ?

Apache Kafka 101

Apache Kafka 101

Hacker News

JULY 13, 2023

While playing Factorio the other day, I was struck by the many similarities with Apache Kafka.

Apache Kafka 178

Apache Kafka 178

Hacker News

MAY 8, 2024

Recently I wanted to learn a bit about Apache Kafka. It is often used as a way to do event sourcing (or similar message-driven architectures). An “add-on” to.

Apache Kafka 107

Apache Kafka 107

IBM Journey to AI blog

APRIL 2, 2024

However, IBM MQ and Apache Kafka can sometimes be viewed as competitors, taking each other on in terms of speed, availability, cost and skills. MQ and Apache Kafka: Teammates Simply put, they are different technologies with different strengths, albeit often perceived to be quite similar. Interested in learning more?

Apache Kafka 81

Apache Kafka Clustering SQL AI 81

Smart Data Collective

AUGUST 17, 2022

You can safely use an Apache Kafka cluster for seamless data movement from the on-premise hardware solution to the data lake using various cloud services like Amazon’s S3 and others. 5 Key Comparisons in Different Apache Kafka Architectures. 5 Key Comparisons in Different Apache Kafka Architectures.

Apache Kafka 100

Apache Kafka ETL Data Lakes AWS 100

Towards AI

FEBRUARY 29, 2024

Within this article, we will explore the significance of these pipelines and utilise robust tools such as Apache Kafka and Spark to manage vast streams of data efficiently. Apache Kafka Apache Kafka is a distributed event streaming platform used for building real-time data pipelines and streaming applications.

Apache Kafka 115

Apache Kafka SQL Clustering Data Pipeline 115

Hacker News

JUNE 15, 2023

Comments (..)

Apache Kafka 97

Apache Kafka 97

Twilio Segment

SEPTEMBER 7, 2021

Event streaming platforms such as Apache Kafka are gaining in importance across all industries. In this article we'll discuss the benefits Apache Kafka implementations can gain from pairing it with a CDP.

Apache Kafka 40

Apache Kafka 40

IBM Journey to AI blog

SEPTEMBER 4, 2024

Apache Kafka is an open-source , distributed streaming platform that allows developers to build real-time, event-driven applications. With Apache Kafka, developers can build applications that continuously use streaming data records and deliver real-time experiences to users. How does Apache Kafka work?

Apache Kafka 59

Apache Kafka Internet of Things Data Pipeline Clustering 59

phData

MAY 3, 2024

How Snowflake Helps Achieve Real-Time Analytics Snowflake is the ideal platform to achieve real-time analytics for several reasons, but two of the biggest are its ability to manage concurrency due to the multi-cluster architecture of Snowflake and its robust connections to 3rd party tools like Kafka. Looking for additional help?

Apache Kafka 52

Apache Kafka Analytics Analytics ETL 52

IBM Journey to AI blog

JANUARY 8, 2024

They often use Apache Kafka as an open technology and the de facto standard for accessing events from a various core systems and applications. IBM provides an Event Streams capability build on Apache Kafka that makes events manageable across an entire enterprise.

EDA 110

EDA Apache Kafka Clustering Data Governance 110

IBM Journey to AI blog

NOVEMBER 21, 2023

Apache Kafka is a well-known open-source event store and stream processing platform and has grown to become the de facto standard for data streaming. Apache Kafka transfers data without validating the information in the messages.

Apache Kafka 119

Apache Kafka Clustering Data Quality Data Governance 119

IBM Journey to AI blog

MAY 9, 2023

IBM Event Automation provides an intuitive and integrated experience for distributing, discovering and processing business events across the organization: Event distribution: Collect raw streams of real-time business events with enterprise-grade Apache Kafka.

Apache Kafka 111

Apache Kafka Business Intelligence Business Intelligence 111

ODSC - Open Data Science

FEBRUARY 6, 2024

Apache Kafka For data engineers dealing with real-time data, Apache Kafka is a game-changer. Spark offers a versatile range of functionalities, from batch processing to stream processing, making it a comprehensive solution for complex data challenges.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

IBM Journey to AI blog

JULY 12, 2024

With its intuitive UI, it makes it easy to produce a valid AsyncAPI document for any Kafka cluster or system that adheres to the Apache Kafka protocol. One of the key benefits of event endpoint management is that it allows you to describe events in a standardized way according to the AysncAPI specification.

Apache Kafka 40

Apache Kafka Clustering 40

Precisely

JULY 21, 2023

Used by more than 75% of the Fortune 500, Apache Kafka has emerged as a powerful open source data streaming platform to meet these challenges. But harnessing and integrating Kafka’s full potential into enterprise environments can be complex. This is where Confluent steps in.

Apache Kafka 52

Apache Kafka Data Silos Data Pipeline Analytics 52

Precisely

DECEMBER 28, 2023

One very popular platform is Apache Kafka , a powerful open-source tool used by thousands of companies. But in all likelihood, Kafka doesn’t natively connect with the applications that contain your data. It also allows for applications, analytics, and reporting to process information as it happens.

Data Pipeline 91

Data Pipeline Apache Kafka Big Data Big Data 91

Pickl AI

JULY 25, 2024

Apache Kafka An open-source platform designed for real-time data streaming. Popular options include Apache Kafka for real-time streaming, Apache Spark for batch and stream processing, Talend for ETL, and cloud-based solutions like AWS Glue, Azure Data Factory, and Google Cloud Dataflow.

Apache Kafka 52

Apache Kafka Data Lakes Data Warehouse Data Quality 52

ODSC - Open Data Science

JUNE 7, 2023

Bilokon | Visiting Lecturer, CEO and Founder | Imperial College London, Thalesians Ltd Apache Kafka for Real-Time Machine Learning Without a Data Lake: Kai Waehner | Global Field CTO, Author, International Speaker Semantic Analysis and Procedural Language Understanding in the Era of Large Language Models: Dr.

Apache Kafka 52

Apache Kafka Machine Learning Machine Learning Data Science 52

Precisely

SEPTEMBER 12, 2023

Precisely data integrity solutions fuel your Confluent and Apache Kafka streaming data pipelines with trusted data that has maximum accuracy, consistency, and context and we’re ready to share more with you at the upcoming Current 2023. Let’s cover some additional information to know before attending.

Data Silos 52

Data Silos Apache Kafka Data Pipeline Data Quality 52

IBM Journey to AI blog

MARCH 14, 2024

Apache Kafka stands as a widely recognized open source event store and stream processing platform. One key advantage of opting for managed Kafka services is the delegation of responsibility for broker and operational metrics, allowing users to focus solely on metrics specific to applications.

Apache Kafka 111

Apache Kafka Data Pipeline 111

ODSC - Open Data Science

JULY 22, 2023

Leverage Compound Sparsity to Achieve the Fastest Inference Performance on CPUs: Damian Bogunowicz | Neural Magic and Konstantin Gulin | Machine Learning Engineer | Neural Magic Apache Kafka for Real-Time Machine Learning Without a Data Lake: Kai Waehner | Global Field CTO | Author, International Speaker Time Series Forecasting for Managers — All Forecasts (..)

Apache Kafka 52

Apache Kafka Machine Learning Machine Learning Data Science 52