Data Science Blog

NOVEMBER 15, 2023

In addition to Business Intelligence (BI), Process Mining is no longer a new phenomenon, but almost all larger companies are conducting this data-driven process analysis in their organization. The Event Log Data Model for Process Mining Process Mining as an analytical system can very well be imagined as an iceberg.

Data Modeling 245

Data Modeling Data Models Business Intelligence Business Intelligence 245

IBM Journey to AI blog

SEPTEMBER 5, 2024

Everything is data—digital messages, emails, customer information, contracts, presentations, sensor data—virtually anything humans interact with can be converted into data, analyzed for insights or transformed into a product. Managing this level of oversight requires adept handling of large volumes of data.

Data Governance 75

Data Governance Data Quality DataOps Artificial Intelligence 75

Data Science Dojo

JULY 6, 2023

It allows data engineers to build, test, and maintain data pipelines in a version-controlled manner. dbt focuses on transforming raw data into analytics-ready tables using SQL-based transformations. Looker: Looker is a business intelligence and data visualization platform.

Data Engineer 195

Data Engineer Data Engineering Data Engineering Data Engineering 195

Alation

SEPTEMBER 7, 2021

In the previous blog , we discussed how Alation provides a platform for data scientists and analysts to complete projects and analysis at speed. In this blog we will discuss how Alation helps minimize risk with active data governance. So why are organizations not able to scale governance? Meet Governance Requirements.

Data Governance 59

Data Governance Data Scientist Data Quality Data Profiling 59

Dataconomy

SEPTEMBER 4, 2023

Key features of cloud analytics solutions include: Data models , Processing applications, and Analytics models. Data models help visualize and organize data, processing applications handle large datasets efficiently, and analytics models aid in understanding complex data sets, laying the foundation for business intelligence.

Analytics 203

Analytics Analytics Big Data Analytics Big Data Analytics 203

phData

SEPTEMBER 19, 2023

However, to fully harness the potential of a data lake, effective data modeling methodologies and processes are crucial. Data modeling plays a pivotal role in defining the structure, relationships, and semantics of data within a data lake. Consistency of data throughout the data lake.

Data Lakes 52

Data Lakes Data Modeling Data Models Data Warehouse 52

phData

SEPTEMBER 11, 2023

Row-level security is a powerful data governance capability across many business intelligence platforms, and Power BI is no exception. Dynamic RLS is more complex and requires logic to be defined within the PBIX file and the data model using relationships (explained later). Use this feature with caution.

Power BI 101

Power BI Data Modeling Data Models Data Governance 101

DataRobot

JANUARY 20, 2022

Specialized teams from DataRobot and Snowflake will enable ICSs to mitigate data governance and model bias risk with confidence. Public sector data sharing.

Data Science 145

Data Science Data Warehouse Analytics Analytics 145

The Data Administration Newsletter

APRIL 20, 2021

Steve Hoberman has been a long-time contributor to The Data Administration Newsletter (TDAN.com), including his The Book Look column since 2016, and his The Data Modeling Addict column years before that.

Data Governance 52

Data Governance Data Modeling Data Models Business Intelligence 52

The Data Administration Newsletter

DECEMBER 20, 2022

Over the past few months, my team in Castlebridge and I have been working with clients delivering training to business and IT teams on data management skills like data governance, data quality management, data modelling, and metadata management.

Data Governance 52

Data Governance Data Quality Data Modeling Data Models 52

Pickl AI

JULY 3, 2023

What is Business Intelligence? Business Intelligence (BI) refers to the technology, techniques, and practises that are used to gather, evaluate, and present information about an organisation in order to assist decision-making and generate effective administrative action. billion in 2015 and reached around $26.50

Business Intelligence 52

Business Intelligence Business Intelligence SQL Data Visualization 52

ODSC - Open Data Science

SEPTEMBER 27, 2023

In contrast, data warehouses and relational databases adhere to the ‘Schema-on-Write’ model, where data must be structured and conform to predefined schemas before being loaded into the database. Storage Optimization: Data warehouses use columnar storage formats and indexing to enhance query performance and data compression.

Data Lakes 98

Data Lakes Data Warehouse Database Big Data 98

Women in Big Data

DECEMBER 9, 2024

Introduction In the rapidly evolving landscape of data analytics, Business Intelligence (BI) tools have become indispensable for organizations seeking to leverage their big data stores for strategic decision-making. Its costs are associated with its enterprise-focused features and advanced data modeling capabilities.

Big Data 52

Big Data Big Data Power BI Tableau 52

Dataversity

FEBRUARY 19, 2021

Enterprises are modernizing their data platforms and associated tool-sets to serve the fast needs of data practitioners, including data scientists, data analysts, business intelligence and reporting analysts, and self-service-embracing business and technology personnel.

Data Analyst 59

Data Analyst Data Scientist Business Intelligence Business Intelligence 59

ODSC - Open Data Science

JUNE 12, 2023

This article is an excerpt from the book Expert Data Modeling with Power BI, Third Edition by Soheil Bakhshi, a completely updated and revised edition of the bestselling guide to Power BI and data modeling. Then we have some other ETL processes to constantly land the past 5 years of data into the Datamarts.

Power BI 52

Power BI Data Warehouse ETL Data Preparation 52

Alation

FEBRUARY 13, 2020

This achievement is a testament not only to our legacy of helping to create the data catalog category but also to our continued innovation in improving the effectiveness of self-service analytics. A broader definition of Business Intelligence. Howard Dresner coined the term “Business Intelligence” in 1989.

Business Intelligence 52

Business Intelligence Business Intelligence Analytics Analytics 52

IBM Journey to AI blog

JANUARY 5, 2023

The right data architecture can help your organization improve data quality because it provides the framework that determines how data is collected, transported, stored, secured, used and shared for business intelligence and data science use cases. Make a dataset’s value immediately understandable.

Data Quality 52

Data Quality Data Lakes Data Warehouse Big Data 52

Pickl AI

AUGUST 11, 2024

To handle sparse data effectively, consider using junk dimensions to group unrelated attributes or creating factless fact tables that capture events without associated measures. Ensuring Data Consistency Maintaining data consistency across multiple fact tables can be challenging, especially when dealing with conformed dimensions.

Data Quality 52

Data Quality Data Warehouse Data Governance Analytics 52

Pickl AI

JUNE 18, 2024

Discover best practices for successful implementation and propel your organization towards data-driven success. Introduction to Power BI Project s The world of Data Analysis is constantly evolving, and Power BI stands at the forefront of this transformation. This allows them to focus on specific aspects of the data story.

Power BI 52

Power BI Data Analysis Data Analysis Data Visualization 52

Mlearning.ai

FEBRUARY 16, 2023

Today, companies are facing a continual need to store tremendous volumes of data. The demand for information repositories enabling business intelligence and analytics is growing exponentially, giving birth to cloud solutions. Data warehousing is a vital constituent of any business intelligence operation.

Data Warehouse 52

Data Warehouse Business Intelligence Business Intelligence Database 52

phData

AUGUST 10, 2023

The implementation of a data vault architecture requires the integration of multiple technologies to effectively support the design principles and meet the organization’s requirements. Data Vault Automation Working at scale can be challenging, especially when managing the data model.

SQL 52

SQL Data Observability Data Quality Data Pipeline 52

The Data Administration Newsletter

JANUARY 17, 2024

Eric Siegel’s “The AI Playbook” serves as a crucial guide, offering important insights for data professionals and their internal customers on effectively leveraging AI within business operations.

AI 122

AI AI Data Quality Data Governance 122

Pickl AI

DECEMBER 4, 2023

Exploring technologies like Data visualization tools and predictive modeling becomes our compass in this intricate landscape. Data governance and security Like a fortress protecting its treasures, data governance, and security form the stronghold of practical Data Intelligence.

Data Analysis 52

Data Analysis Data Analysis Artificial Intelligence Artificial Intelligence 52

Alation

DECEMBER 21, 2022

A data catalog is a metadata repository of information sources across the enterprise, including data sets, business intelligence reports, visualizations, and conversations. Early on, analysts used data catalogs to find and understand data more quickly. MDM Model Objects.

Data Quality 52

Data Quality Data Warehouse Data Profiling Data Governance 52

The Data Administration Newsletter

JUNE 21, 2022

Twenty-five years ago today, I published the first issue of The Data Administration Newsletter. It only took a few months to recognize that there was an audience for an “online” publication focused on data administration. […].

Data Quality 78

Data Quality Data Governance Data Modeling Data Models 78

phData

JULY 18, 2023

CDWs are designed for running large and complex queries across vast amounts of data, making them ideal for centralizing an organization’s analytical data for the purpose of business intelligence and data analytics applications. However, merely knowing what it consists of isn’t enough.

Data Warehouse 52

Data Warehouse Analytics Analytics Cloud Data 52

phData

JULY 11, 2023

Once the data is loaded into the data mart, users can define relationships, as well as policies for business intelligence and analysis, and is automatically available as a semantic layer in the form of a Power BI Dataset within the same workspace that the data mart was created in.

Power BI 40

Power BI SQL Azure ETL 40

phData

JULY 10, 2024

Sigma Computing is a cloud-based business intelligence and analytics tool for collaborative data exploration, analysis, and visualization. Unlike traditional BI tools, its user-friendly interface ensures that users of all technical levels can seamlessly interact with data. Choose your desired data source type (e.g.,

SQL 52

SQL Data Warehouse Analytics Analytics 52

The Data Administration Newsletter

APRIL 17, 2024

The focus of my last column, titled Crossing the Data Divide: Data Catalogs and the Generative AI Wave, was on the impact of large language models (LLM) and generative artificial intelligence (AI) and how we disseminate knowledge throughout the enterprise and the future role of the data catalogs.

Artificial Intelligence 52

Artificial Intelligence Artificial Intelligence AI AI 52

Dataversity

SEPTEMBER 28, 2022

Data engineering is a fascinating and fulfilling career – you are at the helm of every business operation that requires data, and as long as users generate data, businesses will always need data engineers. The journey to becoming a successful data engineer […].

Data Engineer 52

Data Engineer Data Engineering Data Engineering Data Engineering 52

phData

MAY 6, 2025

A dataset is a reusable data model that empowers users to create reports, dashboards, and analyses without directly accessing the underlying database. Its functionality comprises standing as an intermediary between raw data and visualizations and, thereby, acts as the place to facilitate ease of data exploration and analysis.

SQL 52

SQL Database Data Warehouse Analytics 52

The Data Administration Newsletter

FEBRUARY 19, 2025

Data often arrives from multiple sources in inconsistent forms, including duplicate entries from CRM systems, incomplete spreadsheet records, and mismatched naming conventions across databases. These issues slow analysis pipelines and demand time-consuming cleanup.

Data Preparation 52

Data Preparation Machine Learning Machine Learning Database 52