ODSC - Open Data Science

JANUARY 30, 2024

Data engineering is a hot topic in the AI industry right now. And as data’s complexity and volume grow, its importance across industries will only become more noticeable. But what exactly do data engineers do? So let’s do a quick overview of the job of data engineer, and maybe you might find a new interest.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

Pickl AI

NOVEMBER 4, 2024

Summary: The fundamentals of Data Engineering encompass essential practices like data modelling, warehousing, pipelines, and integration. Understanding these concepts enables professionals to build robust systems that facilitate effective data management and insightful analysis. What is Data Engineering?

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

FEBRUARY 15, 2024

We couldn’t be more excited to announce the first sessions for our second annual Data Engineering Summit , co-located with ODSC East this April. Join us for 2 days of talks and panels from leading experts and data engineering pioneers. Is Gen AI A Data Engineering or Software Engineering Problem?

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

FEBRUARY 6, 2024

Data engineering has become an integral part of the modern tech landscape, driving advancements and efficiencies across industries. So let’s explore the world of open-source tools for data engineers, shedding light on how these resources are shaping the future of data handling, processing, and visualization.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

JANUARY 18, 2024

Data engineering is a rapidly growing field, and there is a high demand for skilled data engineers. If you are a data scientist, you may be wondering if you can transition into data engineering. In this blog post, we will discuss how you can become a data engineer if you are a data scientist.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

phData

NOVEMBER 9, 2023

This blog was originally written by Keith Smith and updated for 2024 by Justin Delisi. Snowflake’s Data Cloud has emerged as a leader in cloud data warehousing. What is a Cloud Data Warehouse? For example, most data warehouse workloads peak during certain times, say during business hours.

Data Warehouse 98

Data Warehouse Data Lakes Clustering Cloud Data 98

IBM Journey to AI blog

OCTOBER 22, 2024

Leaders feel the pressure to infuse their processes with artificial intelligence (AI) and are looking for ways to harness the insights in their data platforms to fuel this movement. Indeed, IDC has predicted that by the end of 2024, 65% of CIOs will face pressure to adopt digital tech , such as generative AI and deep analytics.

Data Silos 102

Data Silos Data Pipeline DataOps Business Intelligence 102

ODSC - Open Data Science

OCTOBER 7, 2024

Booths and Partners NVIDIA : Essential for AI professionals, NVIDIA’s GPUs power deep learning and data-intensive AI applications This year, NVIDIA is hosting an in-person and virtual Hackathon at ODSC West 2024. And before the hackathon starts, make sure to begin your journey with NVIDIA’s exclusive webinar.

Data Scientist 52

Data Scientist Data Science Machine Learning Machine Learning 52

ODSC - Open Data Science

APRIL 4, 2024

ODSC Highlights Announcing the Keynote and Featured Speakers for ODSC East 2024 The keynotes and featured speakers for ODSC East 2024 have won numerous awards, authored books and widely cited papers, and shaped the future of data science and AI with their research. Learn more about them here!

Data Visualization 52

Data Visualization Analytics Analytics Big Data Analytics 52

phData

JUNE 26, 2024

Cleaning and preparing the data Raw data typically shouldn’t be used in machine learning models as it’ll throw off the prediction. Data engineers can prepare the data by removing duplicates, dealing with outliers, standardizing data types and precision between data sets, and joining data sets together.

Machine Learning 52

Machine Learning Machine Learning Data Engineering Data Engineering 52

ODSC - Open Data Science

FEBRUARY 19, 2025

In the world of AI-driven data workflows, Brij Kishore Pandey, a Principal Engineer at ADP and a respected LinkedIn influencer, is at the forefront of integrating multi-agent systems with Generative AI for ETL pipeline orchestration. The stepsinclude: Extraction : Data is collected from multiple sources (databases, APIs, flatfiles).

ETL 52

ETL AI AI Data Warehouse 52

phData

MAY 14, 2024

They will focus on organizing data for quicker queries, optimizing virtual data warehouses, and refining query processes. The result is a data warehouse offering faster query responses, improved performance, and cost efficiency throughout your Snowflake account.

SQL 52

SQL Data Warehouse Data Engineering Data Engineering 52

Pickl AI

JUNE 7, 2024

Let’s unlock the power of ETL Tools for seamless data handling. Also Read: Top 10 Data Science tools for 2024. It is a process for moving and managing data from various sources to a central data warehouse. This process ensures that data is accurate, consistent, and usable for analysis and reporting.

ETL 40

ETL Data Quality Data Pipeline Data Warehouse 40

databricks

JUNE 12, 2025

Declarative pipelines hide the complexity of modern data engineering under a simple, intuitive programming model. As an engineering manager, I love the fact that my engineers can focus on what matters most to the business. Data Engineer, 84.51° What’s Next Stay tuned for more details in the Apache Spark documentation.

SQL 249

SQL Data Engineering Data Engineering Data Engineer 249

Data Science Blog

SEPTEMBER 3, 2024

Der Gartner´s Magic Quadrant zu Process Mining Tools für 2024 zeigt einige Movements im Vergleich zu 2023. Process Mining Tool im Gartner Magic Quadrant Chart – 2023 vs 2024 Auch wenn ich große Ehrfurcht gegenüber Gartner als Quelle habe, bin ich jedoch nicht sicher, wie weit die Datengrundlage für die Feststellung geht.

Data Science 130

Data Science Power BI Azure Data Warehouse 130

phData

OCTOBER 28, 2024

Modern low-code/no-code ETL tools allow data engineers and analysts to build pipelines seamlessly using a drag-and-drop and configure approach with minimal coding. Matillion ETL for Snowflake is an ELT/ETL tool that allows for the ingestion, transformation, and building of analytics for data in the Snowflake AI Data Cloud.

Python 52

Python ETL AWS Database 52

Flipboard

MAY 15, 2025

These organizations have a huge demand for lakehouse solutions that combine the best of data warehouses and data lakes to simplify data management with easy access to all data from their preferred engines. Amazon SageMaker Unified Studio , Amazon EMR 7.5.0 and higher, and AWS Glue 5.0

AWS 132

AWS SQL Data Lakes Data Warehouse 132

databricks

JUNE 16, 2025

UC’s core APIs and both server and client implementations have been available as open source since June 2024. We describe the primary design challenges and how UC’s architecture meets them, and share insights from usage across thousands of customer deployments that validate its design choices.

Data Science 130

Data Science Artificial Intelligence Business Intelligence Business Intelligence 130