ODSC - Open Data Science

MAY 31, 2023

Be sure to check out his talk, “ Apache Kafka for Real-Time Machine Learning Without a Data Lake ,” there! The combination of data streaming and machine learning (ML) enables you to build one scalable, reliable, but also simple infrastructure for all machine learning tasks using the Apache Kafka ecosystem.

Data Lakes 131

Data Lakes Machine Learning Machine Learning Apache Kafka 131

ODSC - Open Data Science

APRIL 23, 2025

With AI credits, teams can streamline the annotation process using intelligent suggestions and quality control mechanisms. Confluent Confluent provides a robust data streaming platform built around Apache Kafka. Amazon Web Services(AWS) AWS offers one of the most extensive AI and ML infrastructures in the world.

Data Scientist 52

Data Scientist Azure Apache Kafka ML 52

ODSC - Open Data Science

FEBRUARY 6, 2024

Apache Kafka For data engineers dealing with real-time data, Apache Kafka is a game-changer. Spark offers a versatile range of functionalities, from batch processing to stream processing, making it a comprehensive solution for complex data challenges.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

JULY 22, 2023

On Wednesday, Henk Boelman, Senior Cloud Advocate at Microsoft, spoke about the current landscape of Microsoft Azure, as well as some interesting use cases and recent developments. Keynotes Our main keynote sessions were held on the virtual side of the conference. You can read the recap here and watch the full keynote here.

Apache Kafka 52

Apache Kafka Machine Learning Machine Learning Data Science 52

Pickl AI

DECEMBER 4, 2024

The rise of advanced technologies such as Artificial Intelligence (AI), Machine Learning (ML) , and Big Data analytics is reshaping industries and creating new opportunities for Data Scientists. Apache Kafka), organisations can now analyse vast amounts of data as it is generated. Here are five key trends to watch.

Data Science 52

Data Science Data Scientist Machine Learning Machine Learning 52

Pickl AI

JULY 25, 2024

Enhanced Data Utilisation Effective ingestion unlocks the full potential of data by making it available for advanced analytics, machine learning, and artificial intelligence applications, driving innovation and business growth. Apache Kafka An open-source platform designed for real-time data streaming.

Apache Kafka 52

Apache Kafka Data Lakes Data Warehouse Data Quality 52

Pickl AI

DECEMBER 2, 2024

Cloud Storage: Services like Amazon S3, Google Cloud Storage, and Microsoft Azure Blob Storage provide scalable storage solutions that can accommodate massive datasets with ease. Key storage solutions include: Data Lakes: Centralised repositories that store raw data in its native format until needed for analysis.

Big Data 52

Big Data Big Data Data Lakes Apache Hadoop 52