The Data Administration Newsletter

OCTOBER 5, 2021

Doug has spoken many times at our Data Modeling Zone conferences over the years, and when I read the book, I can hear him talk in his distinct descriptive and conversational style. The Enrichment Game describes how to improve data quality and data useability […].

Data Quality 52

Data Quality Data Modeling Data Models 52

Dataversity

OCTOBER 7, 2024

Welcome to October 2024’s edition of “Book of the Month.” This month, we’re enjoying some time in the fall sun and the local library diving into Laura Madsen’s “AI & The Data Revolution.” The central theme of this book is the management and impact of artificial intelligence (AI) disruption in the workplace.

Artificial Intelligence 52

Artificial Intelligence Artificial Intelligence AI AI 52

Pickl AI

AUGUST 1, 2023

Aspiring and experienced Data Engineers alike can benefit from a curated list of books covering essential concepts and practical techniques. These 10 Best Data Engineering Books for beginners encompass a range of topics, from foundational principles to advanced data processing methods. What is Data Engineering?

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

Dataversity

SEPTEMBER 18, 2023

As some of you already know, I am dedicating these summer days to the writing of my new book, “99 Questions About Data Management,” which follows in some way the book “20 Things You Have to Know About Data Management.”

Data Governance 111

Data Governance Data Quality 111

The Data Administration Newsletter

JANUARY 17, 2024

Eric Siegel’s “The AI Playbook” serves as a crucial guide, offering important insights for data professionals and their internal customers on effectively leveraging AI within business operations.

AI 122

AI AI Data Quality Data Governance 122

Snorkel AI

DECEMBER 2, 2024

Efficient model evaluation and fine-tuning: After importing baseline data from AWS S3 and accessing LLMs from SageMaker Jumpstart or Bedrock, users can use Snorkel Flow’s LLM evaluation tools to build a customized, comprehensive report on their LLM’s current performance.

AWS 52

AWS Machine Learning Machine Learning Data Preparation 52

The Data Administration Newsletter

DECEMBER 20, 2022

It has been eight years plus since the first edition of my book, Non-Invasive Data Governance: The Path of Least Resistance and Greatest Success, was published by long-time TDAN.com contributor, Steve Hoberman, and his publishing company Technics Publications. The book has now been translated into five languages with […].

Data Governance 91

Data Governance Data Quality 91

Pickl AI

DECEMBER 25, 2024

Its diverse content includes academic papers, web data, books, and code. EleutherAI created the Pile to democratise AI research with high-quality, accessible data. Diversity of Sources : The Pile integrates 22 distinct datasets, including scientific articles, web content, books, and programming code.

Natural Language Processing 52

Natural Language Processing Machine Learning Machine Learning AI 52

Dataversity

JULY 26, 2021

As proponents of lean thinking, we view corporations as data factories that produce information for operations, reporting, and financial modeling. We were inspired by the 1990 groundbreaking book “The Machine that […]. The post Lean Governance: The Next Machine to Change the World appeared first on DATAVERSITY.

Data Governance 98

Data Governance Data Quality 98

Dataversity

MAY 8, 2023

As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. In 2019, I wrote the book “Disrupting Data Governance” because I firmly believe […] The post Dear Laura: How Will AI Impact Data Governance? appeared first on DATAVERSITY.

Data Governance 95

Data Governance AI AI Data Quality 95

ODSC - Open Data Science

DECEMBER 5, 2023

ODSC West is now a part of our history books, and we couldn’t be happier with how everything turned out. We had our first-ever Halloween party, more book signings, exciting keynotes, and plenty of sessions to fit everyone’s needs.

Data Science 98

Data Science Artificial Intelligence Artificial Intelligence Machine Learning 98

AWS Machine Learning Blog

AUGUST 15, 2024

When SageMaker Data Wrangler finishes importing, you can start transforming the dataset. After you import the dataset, you can first look at the Data Quality Insights Report to see recommendations from SageMaker Canvas on how to improve the data quality and therefore improve the model’s performance.

ML 131

ML ML Data Preparation AWS 131

IBM Journey to AI blog

JANUARY 9, 2024

The entire generative AI pipeline hinges on the data pipelines that empower it, making it imperative to take the correct precautions. 4 key components to ensure reliable data ingestion Data quality and governance: Data quality means ensuring the security of data sources, maintaining holistic data and providing clear metadata.

AI 89

AI AI Data Quality Data Pipeline 89

IBM Journey to AI blog

DECEMBER 16, 2022

You have a specific book in mind, but you have no idea where to find it. You enter the title of the book into the computer and the library’s digital inventory system tells you the exact section and aisle where the book is located. Ensuring data quality is made easier as a result.

Data Quality 52

Data Quality Data Governance Data Scientist Data Wrangling 52

AWS Machine Learning Blog

AUGUST 29, 2023

The batch inference pipeline includes steps for checking data quality against a baseline created by the training pipeline, as well as model quality (model performance) if ground truth labels are available. If the batch inference pipeline discovers data quality issues, it will notify the responsible data scientist via Amazon SNS.

AWS 98

AWS Data Scientist Data Quality Python 98

AWS Machine Learning Blog

NOVEMBER 1, 2024

These tasks include summarization, classification, information retrieval, open-book Q&A, and custom language generation such as SQL. Our experiments demonstrate that careful attention to data quality, hyperparameter optimization, and best practices in the fine-tuning process can yield substantial gains over base models.

Data Preparation 102

Data Preparation Machine Learning Machine Learning ML 102

AWS Machine Learning Blog

JANUARY 15, 2025

The solution uses the following AWS data stores and analytics services: Unstructured data Amazon Simple Storage Service (Amazon S3) buckets are used to store the JSON-based social media feedback data, quality report PDFs (specific to OEMs), and the vehicle and its features images.

AWS 109

AWS SQL AI AI 109

Flipboard

MARCH 22, 2023

We also detail the steps that data scientists can take to configure the data flow, analyze the data quality, and add data transformations. Finally, we show how to export the data flow and train a model using SageMaker Autopilot. Data Wrangler creates the report from the sampled data.

AWS 123

AWS Data Preparation Azure Data Scientist 123

Towards AI

DECEMBER 19, 2024

Finally, it offers best practices for fine-tuning, emphasizing data quality, parameter optimization, and leveraging transfer learning techniques. The GenAI DLP Black Book: Everything You Need to Know About Data Leakage from LLM By Mohit Sewak, Ph.D. This article examines data leakage in LLMs.

Database 104

Database AI AI Data Preparation 104

Towards AI

DECEMBER 21, 2023

They also explore the technical aspects of chunking strategies and data quality in RAG systems. Featured Community post from the Discord Win2881 worked on a project to find answers to 300+ machine learning interview questions by Scraping from Chip Huyen’s book and Prompting GPT-4. Learn AI Together Community section!

AI 111

AI AI Machine Learning Machine Learning 111

Dataversity

OCTOBER 10, 2022

Four years ago, in a fit of naivete, I decided to write a book about Data Governance. I wasn’t naïve about Data Governance – I was naïve about what that book would bring about. After I left my corporate gig, I did a state-of-the-state in the data industry to get a broader understanding […].

Data Governance 52

Data Governance Data Quality 52

DataRobot

AUGUST 18, 2021

Along with raw data entries in these statements, additional financial ratios such as year-on-year changes in return on assets or book-to-market value are useful machine learning features as well. Note that DataRobot also automatically runs Data Quality Assessments on the dataset to identify and remedy potential data quality issues.

Machine Learning 52

Machine Learning Machine Learning AI AI 52

IBM Journey to AI blog

APRIL 20, 2023

Before a bank can start the process of certifying a risk model, they first need to understand what data is being used and how it changes as it moves from a database to a model.

Database 86

Database Data Engineering Data Engineering Data Engineer 86

AWS Machine Learning Blog

MAY 1, 2025

These optimizations are automatically applied, allowing you to focus on data quality and the configurable parameters while benefiting from our research-backed tuning strategies. Outside of work, she enjoys reading books and watching tennis games. Model size selection and performance comparison Choosing between Meta Llama 3.2

AWS 88

AWS ML ML AI 88

Towards AI

FEBRUARY 13, 2024

According to The Information, one agent could use a user’s device to transfer data between documents and spreadsheets or fill out expense reports. The second agent is web-centric: It performs web-based tasks such as collecting public data, creating travel itineraries, or booking airline tickets.

AI 105

AI AI Computer Science Computer Science 105

Flipboard

MAY 30, 2025

Data quality is ownership of the consuming applications or data producers. Governance The two key areas of governance are model and data: Model governance Monitor model for performance, robustness, and fairness. For model security, custom model weights should be encrypted and isolated for different tenants.

AWS 140

AWS AI AI Database 140

Precisely

MAY 2, 2024

These processes are prone to errors, and poor-quality data can lead to delays in order processing and a host of downstream shipping and invoicing problems that put your customer relationships at risk. It’s clear that automation transforms the way we work, in SAP customer master data processes and beyond.

Data Quality 69

Data Quality Data Governance Analytics Analytics 69

Alation

FEBRUARY 17, 2023

In this blog, I’ll address some of the questions we did not have time to answer live, pulling from both Dr. Reichental’s book as well as my own experience as a data governance leader for 30+ years. Can you have proper data management without establishing a formal data governance program? Here’s an example.

Data Governance 52

Data Governance Data Quality Data Analyst Data Pipeline 52

Dataversity

NOVEMBER 21, 2022

As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. In 2019, I wrote the book “Disrupting Data Governance” because I firmly believe […]. The post Dear Laura: Data Governance Budget Woes appeared first on DATAVERSITY.

Data Governance 52

Data Governance Data Quality 52

Alation

APRIL 12, 2022

CDOs have a mandate across the data value chain, across that whole life cycle of data. Data governance also extends across that life cycle. It’s not just about security or privacy or ensuring data quality; it’s also ensuring the right people can access it and use it to deliver value to the organization.”.

Data Quality 52

Data Quality Data Governance Data Silos Analytics 52

Dataversity

MARCH 1, 2021

Data warehouse (DW) testers with data integration QA skills are in demand. Data warehouse disciplines and architectures are well established and often discussed in the press, books, and conferences. Each business often uses one or more data […].

Data Warehouse 52

Data Warehouse ETL Data Governance Data Quality 52

Dataversity

SEPTEMBER 21, 2022

Whether we’re booking a flight or shopping online, we must go through multiple authentication processes to prove our identity. And that’s quite important from an infosec perspective.

Data Governance 52

Data Governance Data Quality Cloud Data 52

Dataversity

AUGUST 8, 2022

As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. In 2019, I wrote the book “Disrupting Data Governance” because I firmly believe […]. The post Dear Laura: Should I Leave My Data Governance Job? appeared first on DATAVERSITY.

Data Governance 52

Data Governance Data Quality 52

Dataversity

JULY 7, 2022

In his latest book, “Why Privacy Matters” (2022), Neil Richards connects privacy with the social power human information provides over others.

Data Governance 52

Data Governance Data Quality 52

Dataversity

FEBRUARY 25, 2022

As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. In 2019, I wrote the book “Disrupting Data Governance” because I firmly believe that […]. The post Dear Laura: What Role Should Leadership Play in Data Governance?

Data Governance 52

Data Governance Data Quality Cloud Data Analytics 52

Dataversity

DECEMBER 13, 2021

As I’ve been working to challenge the status quo on Data Governance – I get a lot of questions about how it will “really” work. In 2019, I wrote the book “Disrupting Data Governance” because I firmly believe that […]. The post Dear Laura: How Can I Build Traction for Data Governance in a Start-Up?

Data Governance 52

Data Governance Data Quality 52

DagsHub

DECEMBER 15, 2024

Improve your data quality for better AI DagsHub helps you easily curate and annotate your vision, audio, and document data with a single platform. Book a Demo Why It Matters for AI Teams Machine learning teams often struggle with fragmented workflows and high infrastructure costs.

ML 52

ML ML AI AI 52