The Data Administration Newsletter

DECEMBER 20, 2022

Over the past few months, my team in Castlebridge and I have been working with clients delivering training to business and IT teams on data management skills like data governance, data quality management, data modelling, and metadata management.

Data Governance 52

Data Governance Data Quality Data Modeling Data Models 52

The Data Administration Newsletter

APRIL 20, 2021

Steve Hoberman has been a long-time contributor to The Data Administration Newsletter (TDAN.com), including his The Book Look column since 2016, and his The Data Modeling Addict column years before that.

Data Governance 52

Data Governance Data Modeling Data Models Business Intelligence 52

The Data Governance Institute

AUGUST 6, 2020

These values appear in thousands and millions of transactions; without change control, different repositories storing master and reference data get out of sync. One role of Data Governance is to set the scope of data-related change management and to oversee change management activities.

Data Governance 52

Data Governance Data Modeling Data Models 52

phData

SEPTEMBER 11, 2023

Row-level security is a powerful data governance capability across many business intelligence platforms, and Power BI is no exception. Dynamic RLS is more complex and requires logic to be defined within the PBIX file and the data model using relationships (explained later). In the new window, click Manage roles.

Power BI 101

Power BI Data Modeling Data Models Data Governance 101

Alation

MAY 31, 2023

The state of data governance is evolving as organizations recognize the significance of managing and protecting their data. With stricter regulations and greater demand for data-driven insights, effective data governance frameworks are critical. What is a data architect?

Data Governance 52

Data Governance Data Quality Data Silos Data Modeling 52

Alation

NOVEMBER 4, 2021

The practitioner asked me to add something to a presentation for his organization: the value of data governance for things other than data compliance and data security. Now to be honest, I immediately jumped onto data quality. Data quality is a very typical use case for data governance.

Data Governance 94

Data Governance Data Quality ML ML 94

IBM Journey to AI blog

MARCH 29, 2024

Enterprise applications serve as repositories for extensive data models, encompassing historical and operational data in diverse databases. Generative AI foundational models train on massive amounts of unstructured and structured data, but the orchestration is critical to success.

AI 94

AI AI Artificial Intelligence Artificial Intelligence 94

The Data Administration Newsletter

FEBRUARY 1, 2022

My new book, Data Model Storytelling[i], describes how data models can be used to tell the story of an organization’s relationships with its Stakeholders (Customers, Suppliers, Dealers, Regulators, etc.), The book describes, […].

Data Modeling 64

Data Modeling Data Models Data Governance 64

Heartbeat

DECEMBER 7, 2023

What are the new data governance trends, “Data Fabric” and “Data Mesh”? I decided to write a series of blogs on current topics: the elements of data governance that I have been thinking about, reading, and following for a while. Advantages: Consistency ensures trust in data governance.

Data Governance 52

Data Governance Deep Learning Deep Learning Artificial Intelligence 52

Data Science Dojo

JULY 6, 2023

It allows data engineers to build, test, and maintain data pipelines in a version-controlled manner. dbt focuses on transforming raw data into analytics-ready tables using SQL-based transformations. Scalability and Performance : Handle large data volumes with optimized processing capabilities.

Data Engineering 195

Data Engineering Data Engineer Data Engineering Data Engineering 195

Dataconomy

SEPTEMBER 4, 2023

Key features of cloud analytics solutions include: Data models , Processing applications, and Analytics models. Data models help visualize and organize data, processing applications handle large datasets efficiently, and analytics models aid in understanding complex data sets, laying the foundation for business intelligence.

Analytics 203

Analytics Analytics Big Data Analytics Big Data Analytics 203

Pickl AI

JUNE 23, 2023

Continuous Learning and Iteration Data-centric AI systems often incorporate mechanisms for continuous learning and adaptation. As new data becomes available, the models can be retrained or fine-tuned to improve their performance over time. Evaluates the performance of AI systems based on model accuracy and performance metrics.

AI 52

AI AI Data Governance Data Quality 52

The Data Administration Newsletter

AUGUST 31, 2021

Can the responsibilities for vocabulary ownership and data ownership by business stakeholders be separate? I have listened to many presentations and read many articles about data governance (or data stewardship if you prefer), but I have never come across anyone saying they can and should be. Should they be?

Data Governance 52

Data Governance Data Modeling Data Models 52

ODSC - Open Data Science

JUNE 12, 2023

This article is an excerpt from the book Expert Data Modeling with Power BI, Third Edition by Soheil Bakhshi, a completely updated and revised edition of the bestselling guide to Power BI and data modeling. No-code/low-code experience using a diagram view in the data preparation layer similar to Dataflows.

Power BI 52

Power BI Data Warehouse ETL Data Preparation 52

The Data Administration Newsletter

SEPTEMBER 21, 2022

Data Mesh and Data as a Product In the first article, I introduced and explained the approach to application development called Domain-Driven Development (or DDD), explained some of the Data Management concerns with this approach, and described how a well-constructed data model can add value to a DDD project by helping to create the Ubiquitous […]. (..)

Data Modeling 52

Data Modeling Data Models Data Governance 52

Precisely

MARCH 27, 2023

Transforming Go-to-Market After years of acquiring and integrating smaller companies, a $37 billion multinational manufacturer of confectionery, pet food, and other food products was struggling with complex and largely disparate processes, systems, and data models that needed to be normalized. million in annual recurring savings.

Data Quality 52

Data Quality Data Lakes Data Governance Data Modeling 52

Dataversity

JUNE 19, 2023

In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline.

Data Pipeline 52

Data Pipeline Database Data Modeling Data Models 52

Tableau

OCTOBER 14, 2021

IT also is the change agent fostering an enterprise-wide culture that prizes data for the impact it makes as the basis for all informed decision-making. Culture change can be hard, but with a flexible data governance framework, platform, and tools to power digital transformation, you can accelerate business growth.

Data Governance 91

Data Governance Tableau Analytics Analytics 91

Pickl AI

JULY 3, 2023

It is the process of converting raw data into relevant and practical knowledge to help evaluate the performance of businesses, discover trends, and make well-informed choices. Data gathering, data integration, data modelling, analysis of information, and data visualization are all part of intelligence for businesses.

Business Intelligence 52

Business Intelligence Business Intelligence SQL Data Visualization 52

Tableau

OCTOBER 14, 2021

IT also is the change agent fostering an enterprise-wide culture that prizes data for the impact it makes as the basis for all informed decision-making. Culture change can be hard, but with a flexible data governance framework, platform, and tools to power digital transformation, you can accelerate business growth.

Data Governance 70

Data Governance Tableau Analytics Analytics 70

ODSC - Open Data Science

APRIL 28, 2023

As much as data quality is critical for AI, AI is critical for ensuring data quality, and for reducing the time to prepare data with automation. Data quality also works hand in hand with data governance. How does this all tie into AI/ML?

ML 98

ML ML Data Silos AI 98

Alation

FEBRUARY 13, 2020

IDC Innovators: Data Intelligence Software Platforms, 2019 Report. In the latest IDC Innovators: Data Intelligence Software Platforms, 2019 3 report, Alation was profiled as one vendor disrupting the data integration and integrity software market with a differentiated data intelligence software platform.

Big Data 52

Big Data Big Data Machine Learning Machine Learning 52

IBM Journey to AI blog

AUGUST 7, 2023

Orion combines these capabilities with other blockchain properties, offering tamper evidence, provenance, data lineage, authenticity and non-repudiation, all while utilizing a standard data model and transactional APIs.

Database 69

Database Data Governance Data Modeling Data Models 69

Data Science Blog

NOVEMBER 15, 2023

New big data architectures and, above all, data sharing concepts such as Data Mesh are ideal for creating a common database for many data products and applications. The Event Log Data Model for Process Mining Process Mining as an analytical system can very well be imagined as an iceberg.

Data Modeling 245

Data Modeling Data Models Business Intelligence Business Intelligence 245

Smart Data Collective

NOVEMBER 24, 2020

Business intelligence software will be more geared towards working with Big Data. Data Governance. One issue that many people don’t understand is data governance. It is evident that challenges of data handling will be present in the future too. SAP Lumira.

Business Intelligence 130

Business Intelligence Business Intelligence Power BI Augmented Analytics 130

Pickl AI

DECEMBER 4, 2023

Exploring technologies like Data visualization tools and predictive modeling becomes our compass in this intricate landscape. Data governance and security Like a fortress protecting its treasures, data governance, and security form the stronghold of practical Data Intelligence.

Data Analysis 52

Data Analysis Data Analysis Artificial Intelligence Artificial Intelligence 52

Precisely

MARCH 7, 2024

Many people use the term to describe a data quality metric. Technical users, including database administrators, might tell you that data integrity concerns whether or not the data conforms to a pre-defined data model. That gives decision-makers visibility to the “whole truth” of their enterprise data.

Data Quality 52

Data Quality Database Administration Data Governance Analytics 52

ODSC - Open Data Science

SEPTEMBER 27, 2023

In contrast, data warehouses and relational databases adhere to the ‘Schema-on-Write’ model, where data must be structured and conform to predefined schemas before being loaded into the database.

Data Lakes 98

Data Lakes Data Warehouse Database Big Data 98

IBM Journey to AI blog

JANUARY 5, 2023

Critical capabilities of modern high-quality data quality management solutions require an organization to: Enforce data governance across an organization by augmenting manual data quality processes with metadata and AI-related technologies. Perform data quality monitoring based on pre-configured rules.

Data Quality 52

Data Quality Data Lakes Data Warehouse Business Intelligence 52

Tableau

MAY 11, 2022

Data refresh failure detection that flags the issue to data users for mitigation and downstream consumers. Data modeling for every data source created in Tableau that shows how to query data in connected database tables and how to include a logical (semantic) layer and a physical layer.

Tableau 94

Tableau Data Warehouse Database Data Analyst 94

Tableau

MAY 11, 2022

Data refresh failure detection that flags the issue to data users for mitigation and downstream consumers. Data modeling for every data source created in Tableau that shows how to query data in connected database tables and how to include a logical (semantic) layer and a physical layer.

Tableau 92

Tableau Data Warehouse Database Data Analyst 92

Tableau

SEPTEMBER 23, 2021

If we asked you, “What does your organization need to help more employees be data-driven?” where would “better data governance” land on your list? We’re all trying to use more data to make decisions, but constantly face roadblocks and trust issues related to data governance. . A data governance framework.

Data Governance 89

Data Governance Analytics Analytics Tableau 89

Pickl AI

MAY 7, 2024

Perform data transformations, such as merging, filtering, and aggregating data Data Analysis and Modeling Analyze data using statistical techniques, data mining, and predictive modeling.

52

52

Tableau

SEPTEMBER 23, 2021

If we asked you, “What does your organization need to help more employees be data-driven?” where would “better data governance” land on your list? We’re all trying to use more data to make decisions, but constantly face roadblocks and trust issues related to data governance. . A data governance framework.

Data Governance 77

Data Governance Analytics Analytics Tableau 77

ODSC - Open Data Science

APRIL 26, 2023

Because of this, they will be required to work closely with business stakeholders, data teams, and even other tech-focused members of an organization to sure that the needs of the organization are met and comply with overall business objectives.

Data Analyst 52

Data Analyst Machine Learning Machine Learning Power BI 52

Alation

FEBRUARY 13, 2020

Modern data catalogs—originated to help data analysts find and evaluate data—continue to meet the needs of analysts, but they have expanded their reach. They are now central to data stewardship, data curation, and data governance—all metadata dependent activities. But data catalogs do much more.

Data Lakes 52

Data Lakes Data Governance Data Science Data Analyst 52

Pickl AI

JULY 25, 2023

Data Integration and ETL (Extract, Transform, Load) Data Engineers develop and manage data pipelines that extract data from various sources, transform it into a suitable format, and load it into the destination systems. Data Quality and Governance Ensuring data quality is a critical aspect of a Data Engineer’s role.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52