phData

OCTOBER 2, 2023

In this blog post, we’ll explore what a feature store is in the first place, explore a few of the key advantages (and disadvantages), and touch on when is the right time for your organization to build or adopt a feature store. You’ve got machine learning questions, we’ve got machine learning answers. Use case limitations.

Data Warehouse 98

Data Warehouse ML ML Data Scientist 98

The MLOps Blog

MARCH 15, 2023

Data Processing : You need to save the processed data through computations such as aggregation, filtering and sorting. Data Storage : To store this processed data to retrieve it over time – be it a data warehouse or a data lake. Credits can be purchased for 14 cents per minute.

Data Pipeline 59

Data Pipeline ETL SQL Data Quality 59

AWS Machine Learning Blog

NOVEMBER 1, 2023

Organizations can search for PII using methods such as keyword searches, pattern matching, data loss prevention tools, machine learning (ML), metadata analysis, data classification software, optical character recognition (OCR), document fingerprinting, and encryption.

AWS 87

AWS Machine Learning Machine Learning Clustering 87

Alation

MARCH 1, 2022

Lineage helps them identify the source of bad data to fix the problem fast. Manual lineage will give ARC a fuller picture of how data was created between AWS S3 data lake, Snowflake cloud data warehouse and Tableau (and how it can be fixed). Time is money,” said Leonard Kwok, Senior Data Analyst, ARC.

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

phData

JANUARY 15, 2024

Security is the protective shield that guards your data against hackers and unauthorized access, while Compliance is a set of rules and guidelines that ensures data is handled correctly by following laws, ethics, and industry standards. Together, they ensure your data is protected while not breaking any rules.

Data Governance 52

Data Governance Database Data Warehouse Cloud Computing 52

phData

FEBRUARY 6, 2024

In this blog, we’ll discuss the basics of dbt build , run , and test , when you should use each of the commands, and finish with some tips on how to optimize your pipelines leveraging dbt. There are currently 19 different selector methods, with some of the most powerful being tag , config , group , state , result , and source_status.

Data Pipeline 52

Data Pipeline Database SQL Data Warehouse 52

Iguazio

JANUARY 22, 2024

But doing so requires significant engineering, quality data and overcoming risks. In this blog post, we show all the elements and practices you need to to take to productize LLMs and generative AI. You can watch the full talk this blog post is based on, which took place at ODSC West 2023, here.

Data Pipeline 52

Data Pipeline ML ML Database 52

phData

APRIL 18, 2023

Data, technology, and improved trade execution could all be utilized by businesses to increase investment returns, spur innovation, and provide better investor experiences. Once that data is tagged, an access history log is available as required for regulatory compliance.

Data Silos 52

Data Silos ETL Clustering Data Warehouse 52

phData

FEBRUARY 8, 2024

Data Modeling, dbt has gradually emerged as a powerful tool that largely simplifies the process of building and handling data pipelines. dbt is an open-source command-line tool that allows data engineers to transform, test, and document the data into one single hub which follows the best practices of software engineering.

Data Modeling 52

Data Modeling Data Models Database Data Warehouse 52

Alation

OCTOBER 27, 2022

Few actors in the modern data stack have inspired the enthusiasm and fervent support as dbt. This data transformation tool enables data analysts and engineers to transform, test and document data in the cloud data warehouse. We also populated our internal data catalog with these descriptions.

Data Analyst 52

Data Analyst Data Scientist Data Warehouse Analytics 52

Alation

JANUARY 25, 2022

Data fabric is now on the minds of most data management leaders. In our previous blog, Data Mesh vs. Data Fabric: A Love Story , we defined data fabric and outlined its uses and motivations. The data catalog is a foundational layer of the data fabric. Social signals around data are powerful.

DataOps 52

DataOps SQL ML ML 52

AWS Machine Learning Blog

APRIL 4, 2024

The following figure shows an example of our tagging system. The analyst is given direct access to the raw data or through our data warehouse. For example, we identify if the brand is on a banner or a shirt. In addition, we identify the location of the brand on the item, such as the top corner of a sign or the sleeve.

AWS 75

AWS Machine Learning Machine Learning ML 75

phData

APRIL 20, 2023

In today’s world, data-driven applications demand more flexibility, scalability, and auditability, which traditional data warehouses and modeling approaches lack. This is where the Snowflake Data Cloud and data vault modeling comes in handy. What is Data Vault Modeling?

Data Warehouse 72

Data Warehouse Data Governance Clustering Database 72

Alation

APRIL 19, 2022

Data modernization is the process of transferring data to modern cloud-based databases from outdated or siloed legacy databases, including structured and unstructured data. In that sense, data modernization is synonymous with cloud migration. 5 Benefits of Data Modernization. Subscribe to Alation's Blog.

Data Governance 52

Data Governance Cloud Data Database Data Lakes 52

IBM Journey to AI blog

AUGUST 3, 2023

IBM Security® Guardium® Data Protection empowers security teams to safeguard sensitive data through discovery and classification, data activity monitoring, vulnerability assessments and advanced threat detection.

Azure 62

Azure Database Natural Language Processing Analytics 62

Alation

AUGUST 9, 2021

Data sets need to be thoroughly annotated or tagged with keywords that business users commonly use. Data catalogs , like Alation, are often a business user’s point of entry to data. See how a data catalog empowers more people to join the data conversation. Subscribe to Alation's Blog.

Analytics 98

Analytics Analytics Data Warehouse Data Scientist 98

Alation

JANUARY 27, 2022

The proliferation of data sources means there is an increase in data volume that must be analyzed. Large volumes of data have led to the development of data lakes , data warehouses, and data management systems. Despite its immense value, a variety of data can create more work.

Data Governance 52

Data Governance Analytics Analytics Data Quality 52

Alation

AUGUST 26, 2021

As you use a data catalog more extensively, you’ll be exposed to other forms of metadata: People metadata: Describes those who work with data, including consumers, curators, stewards, and subject matter experts. Search metadata: Supports tagging and keywords to help people find relevant data. Data curation.

Data Governance 64

Data Governance ML ML Artificial Intelligence 64