IBM Journey to AI blog

JANUARY 18, 2023

Data platform architecture has an interesting history. Towards the turn of millennium, enterprises started to realize that the reporting and business intelligence workload required a new solution rather than the transactional applications. A read-optimized platform that can integrate data from multiple applications emerged.

Data Lakes 52

Data Lakes Data Warehouse Apache Hadoop Azure 52

ODSC - Open Data Science

JUNE 12, 2023

This article is an excerpt from the book Expert Data Modeling with Power BI, Third Edition by Soheil Bakhshi, a completely updated and revised edition of the bestselling guide to Power BI and data modeling. A quick search on the Internet provides multiple definitions by technology-leading companies such as IBM, Amazon, and Oracle.

Power BI 52

Power BI Data Warehouse ETL Data Preparation 52

AWS Machine Learning Blog

JUNE 25, 2024

To create and share customer feedback analysis without the need to manage underlying infrastructure, Amazon QuickSight provides a straightforward way to build visualizations, perform one-time analysis, and quickly gain business insights from customer feedback, anytime and on any device. The Step Functions workflow starts.

AWS 128

AWS Natural Language Processing Machine Learning Machine Learning 128

IBM Journey to AI blog

JULY 1, 2024

Extraction, transformation and loading (ETL) tools dominated the data integration scene at the time, used primarily for data warehousing and business intelligence. The first two use cases are primarily aimed at a technical audience, as the lineage definitions apply to actual physical assets.

ETL 40

ETL Data Lakes Database Data Pipeline 40

Pickl AI

AUGUST 1, 2023

Key Components of Data Engineering Data Ingestion : Gathering data from various sources, such as databases, APIs, files, and streaming platforms, and bringing it into the data infrastructure. Data Processing: Performing computations, aggregations, and other data operations to generate valuable insights from the data.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

Alation

APRIL 14, 2022

For example, data science always consumes “historical” data, and there is no guarantee that the semantics of older datasets are the same, even if their names are unchanged. Pushing data to a data lake and assuming it is ready for use is shortsighted. On-premises business intelligence and databases.

Data Governance 59

Data Governance ML ML Cloud Data 59

Alation

MARCH 21, 2023

Having been in business for over 50 years, ARC had accumulated a massive amount of data that was stored in siloed, on-premises servers across its 7 business domains. Using Alation, ARC automated the data curation and cataloging process. “So

Analytics 52

Analytics Analytics Data Silos Big Data 52

Alation

JANUARY 26, 2023

Lack of data governance can summon a whole range of problems, including: Lack of consistency For data to be useful, it should be consistent across all areas. A field might not be entered in the same way across different departments, which makes the data difficult to find and affects the accuracy of business intelligence (BI).

Data Governance 52

Data Governance Data Engineering Data Engineering Data Engineering 52

Data Science Blog

MAY 15, 2023

tl;dr Ein Data Lakehouse ist eine moderne Datenarchitektur, die die Vorteile eines Data Lake und eines Data Warehouse kombiniert. Die Definition eines Data Lakehouse Ein Data Lakehouse ist eine moderne Datenspeicher- und -verarbeitungsarchitektur, die die Vorteile von Data Lakes und Data Warehouses vereint.

Data Warehouse 147

Data Warehouse Data Lakes Azure AWS 147

Data Science Blog

MARCH 14, 2023

Datenqualität hingegen, wurde zum wichtigen Faktor jeder Unternehmensbewertung, was Themen wie Reporting, Data Governance und schließlich dann das Data Engineering mehr noch anschob als die Data Science. Google Trends – Big Data (blue), Data Science (red), Business Intelligence (yellow) und Process Mining (green).

Big Data 147

Big Data Big Data Apache Hadoop Data Science 147

Hacker News

JULY 1, 2025

You’ll own and work with everything from distributed queues and data lakes to prompt evaluation and agentic orchestration. Whether it’s about leveraging LLMs to improve customer support, building data lakes on cloud platforms to improve storage or implementing models using sensor data for quality control.

Python 88

Python AWS ML ML 88