article thumbnail

DataOps Highlights the Need for Automated ETL Testing (Part 2)

Dataversity

DataOps, which focuses on automated tools throughout the ETL development cycle, responds to a huge challenge for data integration and ETL projects in general. The post DataOps Highlights the Need for Automated ETL Testing (Part 2) appeared first on DATAVERSITY. Click to learn more about author Wayne Yaddow. The […].

DataOps 98
article thumbnail

DataOps Highlights the Need for Automated ETL Testing (Part 1)

Dataversity

DataOps, which focuses on automated tools throughout the ETL development cycle, responds to a huge challenge for data integration and ETL projects in general. The post DataOps Highlights the Need for Automated ETL Testing (Part 1) appeared first on DATAVERSITY. Click to learn more about author Wayne Yaddow. The […].

DataOps 52
professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How to use Snowflake Zero Copy Cloning in your CI/CD Pipelines

phData

There are many frameworks for testing software, but the right way to test the data and SQL scripts that change data are less obvious. This is because databases and the data therein are constantly changing. Consider the scenario where you create a view in the database using your Development (DEV) environment.

article thumbnail

Understanding Zero-Code Development Life Cycle in Matillion

phData

Practices centered on software engineering principles can create a barrier to entry for teams with skilled data wranglers looking to take their infrastructure to the next level with cloud-native tools like Matillion for the Snowflake Data Cloud. The admin configures the project to connect to a dedicated marketing database on Snowflake.

ETL 52