IBM Journey to AI blog

JANUARY 5, 2023

The first generation of data architectures represented by enterprise data warehouse and business intelligence platforms were characterized by thousands of ETL jobs, tables, and reports that only a small group of specialized data engineers understood, resulting in an under-realized positive impact on the business.

Data Quality 52

Data Quality Data Lakes Data Warehouse Business Intelligence 52

Data Science Blog

SEPTEMBER 19, 2023

So why using IaC for Cloud Data Infrastructures? Streamlined Collaboration Among Teams Data Warehouse Systems in the cloud often involve cross-functional teams — data engineers, data scientists, and system administrators. The post Why using Infrastructure as Code for developing Cloud-based Data Warehouse Systems?

Data Warehouse 259

Data Warehouse Azure SQL Database 259

AWS Machine Learning Blog

JANUARY 5, 2024

By the end of the consulting engagement, the team had implemented the following architecture that effectively addressed the core requirements of the customer team, including: Code Sharing – SageMaker notebooks enable data scientists to experiment and share code with other team members.

AWS 113

AWS Data Science ML ML 113

phData

JULY 17, 2023

This is where Fivetran and the Modern Data Stack come in. Fivetran is a fully-automated, zero-maintenance data pipeline tool that automates the ETL process from data sources to your cloud warehouse. Snowflake Data Cloud Replication Transferring data from a source system to a cloud data warehouse.

Data Warehouse 52

Data Warehouse Data Pipeline Cloud Data ETL 52

phData

MAY 11, 2023

With the “Data Productivity Cloud” launch, Matillion has achieved a balance of simplifying source control, collaboration, and dataops by elevating Git integration to a “first-class citizen” within the framework. In Matillion ETL, the Git integration enables an organization to connect to any Git offering (e.g.,

ETL 52

ETL Analytics Analytics Data Modeling 52

phData

AUGUST 10, 2023

Data Vault Automation Working at scale can be challenging, especially when managing the data model. Automations provide extra support to small teams by having templates to automate data integration, data vault modeling, and ETL /DDL code generation. This is where automation tools come into play.

SQL 52

SQL Data Observability Data Quality Data Pipeline 52

Alation

OCTOBER 27, 2022

We document these custom models in Alation Data Catalog and publish common queries that other teams can use for operational use cases or reporting needs. Contact title mappings, which are buiilt in some of data models, are documented within our data catalog. Jason: How do you use these models?

Data Analyst 52

Data Analyst Data Scientist Data Warehouse Analytics 52

phData

JULY 18, 2023

Slow Response to New Information: Legacy data systems often lack the computation power necessary to run efficiently and can be cost-inefficient to scale. This typically results in long-running ETL pipelines that cause decisions to be made on stale or old data.

Data Warehouse 52

Data Warehouse SQL Cloud Data Analytics 52