Smart Data Collective

APRIL 20, 2022

Errors in data entry might have serious effects if they are not discovered quickly. Human mistake is the most common cause of data entry errors. Since typical data entry errors may be minimized with the right steps, there are numerous data lineage tool strategies that a corporation can follow. Make Enough Hires.

Data Profiling 136

Data Profiling Data Analysis Data Analysis Database 136

Alation

FEBRUARY 7, 2023

That was my earliest taste of data lineage. It wouldn’t be until 2013 that the topic of data lineage would surface again – this time while working on a data warehouse project. Data warehouses obfuscate data’s origin In 2013, I was a Business Intelligence Engineer at a financial services company.

Data Warehouse 52

Data Warehouse ETL Business Intelligence Business Intelligence 52

Data Science Dojo

AUGUST 28, 2023

From data management to model fine-tuning, LLMOps ensures efficiency, scalability, and risk mitigation. What is LLMOps? Similar to traditional Machine Learning Ops (MLOps), LLMOps necessitates a collaborative effort involving data scientists, DevOps engineers, and IT professionals.

Exploratory Data Analysis 195

Exploratory Data Analysis Data Preparation Machine Learning Machine Learning 195

Alation

FEBRUARY 18, 2021

Alation increases search relevancy with data domains, adds new data governance capabilities, and speeds up time-to-insight with an Open Connector Framework SDK. Categorize data by domain. As a data consumer, sometimes you just want data in a single category. Data quality is essential to data governance.

Data Governance 98

Data Governance Data Quality Data Engineering Data Engineer 98

Alation

NOVEMBER 18, 2021

With this release, we’ve made some nice enhancements to our data lineage capabilities. We’ve invested in two areas to help our customers get more lineage into the data catalog. First, we enhanced our automated lineage capabilities. Talo: Can you talk more about column-level lineage (CLL)? Jason: Simply put?

Data Lakes 52

Data Lakes Data Governance SQL AWS 52

phData

JUNE 15, 2023

Sigma Computing is a cloud-based analytics and business intelligence tool that allows users to explore, analyze, and visualize data from various sources. Sigma Computing offers a user-friendly interface that allows users to drag and drop data sets, create custom calculations, and generate interactive visualizations.

Business Intelligence 52

Business Intelligence Business Intelligence Data Analysis Data Analysis 52

Alation

MARCH 1, 2022

There are many approaches to manage and use data. Despite a plethora of frameworks, ideologies and best practices in the data world, data is fluid and must adapt to unique scenarios. As data complexity increases and organizations become more ‘data driven’, catalogs will continue to rank as a high priority.”.

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

IBM Data Science in Practice

MARCH 8, 2023

Additionally, imagine being a practitioner, such as a data scientist, data engineer, or machine learning engineer, who will have the daunting task of learning how to use a multitude of different tools. This complexity is compounded even further by the need to manage data across hybrid and multi-cloud environments.

Machine Learning 264

Machine Learning Machine Learning ML ML 264

phData

NOVEMBER 13, 2023

Welcome to the lowdown on the Coalesce Conference, where the data community’s pulse thumps at its strongest, hosted by dbt Labs. The conference was filled with various sessions, each offering a deep dive into dbt’s role in data strategy and innovation. That’s no small feat for any data team!

Database 52

Database Business Intelligence Business Intelligence Data Silos 52

Alation

APRIL 4, 2023

Now, joint users will get an enhanced view into cloud and data transformations , with valuable context to guide smarter usage. Integrating helpful metadata into user workflows gives all people, from data scientists to analysts , the context they need to use data more effectively.

DataOps 52

DataOps Data Engineering Data Engineer Data Engineering 52

phData

OCTOBER 27, 2023

If that leaves you looking for more background context, you can jump to our blog called What is a Feature Store? This blog will walk through how to build your own feature platform with batch feature engineering pipelines using Airflow and dbt on the Snowflake Data Cloud. The answer to both questions is no.

Machine Learning 52

Machine Learning Machine Learning Python ML 52

Alation

SEPTEMBER 30, 2022

This June, Snowflake recognized Alation as its data governance partner of the year for the second year in a row, and Eckerson , IDC , BARC , Dresner , and Constellation all released reports just this summer naming Alation a data catalog leader. It’s what your customers are willing to pay for the service you provide.

Data Governance 92

Data Governance Azure SQL Data Quality 92

Pickl AI

OCTOBER 11, 2023

Data Observability and Data Quality are two key aspects of data management. The focus of this blog is going to be on Data Observability tools and their key framework. The growing landscape of technology has motivated organizations to adopt newer ways to harness the power of data. What is Data Observability?

Data Observability 52

Data Observability Data Quality Data Pipeline Data Governance 52

Alation

AUGUST 24, 2021

In the previous blog , we discussed the race to the South Pole of 1911-12, and explored how approach was key. As you consider your journey to the Snowflake Data Cloud, why might a superior approach matter? We discussed how the Alation Data Catalog helps you get to the Snowflake Data Cloud quickly and safely.

Data Scientist 52

Data Scientist Analytics Analytics 52

Alation

APRIL 6, 2023

Data governance is traditionally applied to structured data assets that are most often found in databases and information systems. This blog focuses on governing spreadsheets that contain data, information, and metadata, and must themselves be governed. a spreadsheet. It’s easy to see why these errors occur.

Data Governance 52

Data Governance Database Data Lakes Data Warehouse 52

Smart Data Collective

OCTOBER 13, 2021

There are countless examples of big data transforming many different industries. There is no disputing the fact that the collection and analysis of massive amounts of unstructured data has been a huge breakthrough. This is something that you can learn more about in just about any technology blog. What is data virtualization?

Data Visualization 135

Data Visualization Big Data Big Data Predictive Analytics 135

Towards AI

JUNE 27, 2023

The previous blog post, “Data Acquisition & Exploration: Exploring 5 Key MLOps Questions using AWS SageMaker”, explored how AWS SageMaker’s capabilities can help data scientists collaborate and accelerate data exploration and understanding. This section will focus on running transformations on our transaction data.

AWS 52

AWS Data Scientist Data Wrangling Data Preparation 52

phData

AUGUST 10, 2023

The implementation of a data vault architecture requires the integration of multiple technologies to effectively support the design principles and meet the organization’s requirements. In this blog, our focus will be on exploring the data lifecycle along with several Design Patterns, delving into their benefits and constraints.

SQL 52

SQL Data Observability Data Quality Data Pipeline 52

Iguazio

FEBRUARY 20, 2024

Risk, compliance, data privacy and escalating costs are just a few of the acute concerns that financial services companies are grappling with today. What is the Potential Value of Gen AI and Analytics for Financial Services? Gen AI is quickly reshaping industries, and the pace of innovation is incredible to witness.

AI 52

AI AI Data Pipeline Data Quality 52

phData

AUGUST 16, 2023

In the era of data modernization, organizations face the challenge of managing vast volumes of data while ensuring data integrity, scalability, and agility. In this blog, we will dive deep into the world of data warehousing and explore the advantages of combining Snowflake with the Data Vault architecture.

Data Warehouse 52

Data Warehouse Data Governance SQL Data Modeling 52

IBM Journey to AI blog

JANUARY 25, 2023

In our last blog , we introduced Data Governance: what it is and why it is so important. In this blog, we will explore the challenges that organizations face as they start their governance journey. Organizations have long struggled with data management and understanding data in a complex and ever-growing data landscape.

Data Governance 52

Data Governance Data Silos Data Quality Analytics 52

Alation

SEPTEMBER 22, 2022

Alation is pleased to launch a new strategic partnership with Fivetran, the leader in modern data integration. This new partnership will unify governed, quality data into a single view, granting all stakeholders total visibility into pipelines and providing them with a superior ability to make data-driven decisions.

Data Pipeline 52

Data Pipeline Data Quality Data Governance Data Engineering 52

Flipboard

JUNE 20, 2023

Meet Your New Swiss Army Knife: ChatGPT Imagine having a writing partner who’s there 24/7, ready to assist with everything from brainstorming marketing ideas to crafting perfect blog posts. Enter ChatGPT, the brainchild of OpenAI and the latest iteration in the GPT-4 lineage. What is ChatGPT? You got it. ” 10.

AI 116

AI AI 116

IBM Journey to AI blog

MARCH 4, 2024

Figure 1: Transforming into an AI+ enterprise is at the core of what our team at IBM does An AI+ enterprise integrates AI as a first-class function across the business. AI is at a turning point, driving exponential advancements in an organization’s prosperity and growth. times higher ROI.

AI 101

AI AI Artificial Intelligence Artificial Intelligence 101

DagsHub

DECEMBER 11, 2023

A complete overview revealing a diverse range of strengths and weaknesses for each data versioning tool. To help data practitioners, this blog will cover eight of the top data versioning tools in the market. Why do we need to version our data?

Machine Learning 98

Machine Learning Machine Learning Data Lakes Database 98

phData

AUGUST 21, 2023

This post was co-written by Sam Hall and Dakota Kelley In our previous blog , we talked about some of the challenges that larger enterprise data teams may have around modernizing their data architecture to implement best practices and free up time and resources to build more value using their data.

Data Warehouse 52

Data Warehouse SQL Cloud Data Database 52

Alation

NOVEMBER 28, 2022

Alation is excited to unveil Alation Connected Sheets , a new product that brings trusted, fresh data directly to spreadsheet users. Now, “spreadsheet jockeys” can pull the most current, compliant data directly from a range of cloud sources, without having to know SQL or depend on a data team to deliver it.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

phData

OCTOBER 12, 2023

This blog was co-written by Sam Hall and Dakota Kelley In our previous blog , we discussed some ways Fivetran and dbt solve ELT for enterprise data consumption and analytics. As your data organization grows, the scalability of your data platform matters. Nothing is completely hands off, though.

Data Warehouse 52

Data Warehouse Database Cloud Data Data Pipeline 52

phData

JULY 12, 2023

Businesses today are grappling with vast amounts of data coming from diverse sources. To effectively manage and harness this data, many organizations are turning to a data vault—a flexible and scalable data modeling approach that supports agile data integration and analytics.

Clustering 52

Clustering Data Warehouse Data Quality Data Modeling 52

Alation

MARCH 17, 2021

Key Features of a Machine Learning Data Catalog. Data intelligence is crucial for the development of data catalogs. At the center of this innovation are machine learning data catalogs (MLDCs). Unlike standalone tools, machine learning data catalogs have features like: Data search. Data stewardship.

Machine Learning 52

Machine Learning Machine Learning Data Governance Data Quality 52

phData

APRIL 20, 2023

In today’s world, data-driven applications demand more flexibility, scalability, and auditability, which traditional data warehouses and modeling approaches lack. This is where the Snowflake Data Cloud and data vault modeling comes in handy. What is Snowflake? What is Data Vault Modeling?

Data Warehouse 72

Data Warehouse Data Governance Clustering Database 72

Alation

MARCH 1, 2023

How are blockchain organizations tackling data management? To learn the answer, we sat down with Karla Kirton , Data Architect at Blockdaemon, a blockchain company, to discuss data strategy , decentralization, and how implementing Alation has supported them. What is your data strategy and how did you begin to implement it?

Data Governance 52

Data Governance Data Pipeline Database Analytics 52

phData

JUNE 27, 2023

The modern data stack (MDS) has seen massive changes over the past few decades, fueled by technological advances and new platforms. As a result, we are presented with specialized data platforms, databases, and warehouses. All of which have a specific role used to collect, store, process, and analyze data.

SQL 52

SQL Database Data Quality Data Warehouse 52

The MLOps Blog

JUNE 27, 2023

Alignment to other tools in the organization’s tech stack Consider how well the MLOps tool integrates with your existing tools and workflows, such as data sources, data engineering platforms, code repositories, CI/CD pipelines, monitoring systems, etc. For example, neptune.ai and Pandas or Apache Spark DataFrames.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

IBM Journey to AI blog

JULY 5, 2023

Data Lakes have been around for well over a decade now, supporting the analytic operations of some of the largest world corporations. Such data volumes are not easy to move, migrate or modernize. The challenges of a monolithic data lake architecture Data lakes are, at a high level, single repositories of data at scale.

Data Lakes 63

Data Lakes Data Warehouse Data Governance SQL 63

Alation

FEBRUARY 8, 2022

The “data textile” wars continue! In our first blog in this series , we define the terms data fabric and data mesh. The second blog took a deeper dive into data fabric, examining its key pillars and the role of the data catalog in each. Data as a product. But why is such an inversion needed?

Data Governance 52

Data Governance Data Engineering Data Engineer Data Engineering 52

Alation

DECEMBER 7, 2021

Alation and Soda are excited to announce a new partnership, which will bring powerful data-quality capabilities into the data catalog. Soda’s data observability platform empowers data teams to discover and collaboratively resolve data issues quickly. What are the downstream and upstream dependencies?

Data Quality 52

Data Quality Data Pipeline Data Silos Data Governance 52