AWS Machine Learning Blog

JUNE 5, 2023

To simplify access to Parquet files, Amazon SageMaker Canvas has added data import capabilities from over 40 data sources , including Amazon Athena , which supports Apache Parquet. Canvas provides connectors to AWS data sources such as Amazon Simple Storage Service (Amazon S3), Athena, and Amazon Redshift.

Machine Learning 96

Machine Learning Machine Learning AWS Data Lakes 96

Precisely

MARCH 9, 2023

Data warehouse vs. data lake, each has their own unique advantages and disadvantages; it’s helpful to understand their similarities and differences. In this article, we’ll focus on a data lake vs. data warehouse. It is often used as a foundation for enterprise data lakes.

Data Lakes 59

Data Lakes Data Warehouse Hadoop Big Data 59

AWS Machine Learning Blog

AUGUST 21, 2023

You can streamline the process of feature engineering and data preparation with SageMaker Data Wrangler and finish each stage of the data preparation workflow (including data selection, purification, exploration, visualization, and processing at scale) within a single visual interface.

AWS 98

AWS Data Lakes Clustering Data Preparation 98

Data Science Dojo

JULY 6, 2023

Amazon Redshift: Amazon Redshift is a cloud-based data warehousing service provided by Amazon Web Services (AWS). Amazon Redshift allows data engineers to analyze large datasets quickly using massively parallel processing (MPP) architecture. Airflow An open-source platform for building and scheduling data pipelines.

Data Engineering 195

Data Engineering Data Engineering Data Engineer Data Engineering 195

IBM Journey to AI blog

MARCH 14, 2024

The solution: IBM databases on AWS To solve for these challenges, IBM’s portfolio of SaaS database solutions on Amazon Web Services (AWS), enables enterprises to scale applications, analytics and AI across the hybrid cloud landscape. Let’s delve into the database portfolio from IBM available on AWS. 

AWS 93

AWS Database ETL AI 93

Alation

FEBRUARY 20, 2020

For many enterprises, a hybrid cloud data lake is no longer a trend, but becoming reality. With an on-premise deployment, enterprises have full control over data security, data access, and data governance. Data that needs to be tightly controlled (e.g. AWS Propelling Hybrid Cloud Environments.

Data Lakes 52

Data Lakes Cloud Data AWS Tableau 52

phData

SEPTEMBER 19, 2023

With the amount of data companies are using growing to unprecedented levels, organizations are grappling with the challenge of efficiently managing and deriving insights from these vast volumes of structured and unstructured data. What is a Data Lake? Consistency of data throughout the data lake.

Data Lakes 52

Data Lakes Data Modeling Data Models Data Warehouse 52

AWS Machine Learning Blog

APRIL 30, 2025

This post explores key insights and lessons learned from AWS customers in Europe, Middle East, and Africa (EMEA) who have successfully navigated this transition, providing a roadmap for others looking to follow suit. Il Sole 24 Ore leveraged its vast internal knowledge with a Retrieval Augmented Generation (RAG) solution powered by AWS.

AWS 66

AWS AI AI Machine Learning 66

AWS Machine Learning Blog

FEBRUARY 13, 2024

SageMaker Feature Store now makes it effortless to share, discover, and access feature groups across AWS accounts. With this launch, account owners can grant access to select feature groups by other accounts using AWS Resource Access Manager (AWS RAM). Review the access policy to understand permissions granted.

AWS 128

AWS ML ML Machine Learning 128

Dataconomy

SEPTEMBER 4, 2023

A well-documented case is the UK government’s failed attempt to create a unified healthcare records system, which wasted billions of taxpayer dollars. Downtime, like the AWS outage in 2017 that affected several high-profile websites, can disrupt business operations. Ensure that data is clean, consistent, and up-to-date.

Analytics 203

Analytics Analytics Big Data Analytics Big Data Analytics 203

Alation

NOVEMBER 18, 2021

External Tables Create a Shared View of the Data Lake. We’ve seen external tables become popular with our customers, who use them to provide a normalized relational schema on top of their data lake. Essentially, external tables create a shared view of the data lake, a single pane of glass everyone can reference.

Data Lakes 52

Data Lakes Data Governance SQL AWS 52

AWS Machine Learning Blog

FEBRUARY 7, 2025

This account manages templates for setting up new ML Dev Accounts, as well as SageMaker Projects templates for model development and deployment, in AWS Service Catalog. It also hosts a model registry to store ML models developed by data science teams, and provides a single location to approve models for deployment.

ML 63

ML ML Data Scientist AWS 63

Alation

APRIL 7, 2021

Powered by the industry’s broadest and deepest connectivity, the Alation Data Catalog supports data intelligence use cases across an organization’s de facto hybrid cloud environments. Alation Cloud Service is available on AWS. This ensures the catalog remains as a mission-critical foundation for data intelligence in the cloud.

Data Governance 52

Data Governance AWS Data Silos Data Lakes 52

Precisely

JANUARY 25, 2024

There are three potential approaches to mainframe modernization: Data Replication creates a duplicate copy of mainframe data in a cloud data warehouse or data lake, enabling high-performance analytics virtually in real time, without negatively impacting mainframe performance. Best Practice 5.

Data Governance 69

Data Governance Database Cloud Data Data Lakes 69

Pickl AI

OCTOBER 10, 2024

Support for Advanced Analytics : Transformed data is ready for use in Advanced Analytics, Machine Learning, and Business Intelligence applications, driving better decision-making. Compliance and Governance : Many tools have built-in features that ensure data adheres to regulatory requirements, maintaining data governance across organisations.

Data Quality 52

Data Quality AWS Machine Learning Machine Learning 52

DataRobot Blog

OCTOBER 3, 2017

This highlights the two companies’ shared vision on self-service data discovery with an emphasis on collaboration and data governance. 2) When data becomes information, many (incremental) use cases surface.

Data Lakes 52

Data Lakes Azure Data Pipeline Hadoop 52

Pickl AI

NOVEMBER 4, 2024

Key Takeaways Data Engineering is vital for transforming raw data into actionable insights. Key components include data modelling, warehousing, pipelines, and integration. Effective data governance enhances quality and security throughout the data lifecycle. What is Data Engineering?

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

phData

APRIL 29, 2024

Understanding Fivetran Fivetran is a popular Software-as-a-Service platform that enables users to automate the movement of data and ETL processes across diverse sources to a target destination. The phData team achieved a major milestone by successfully setting up a secure end-to-end data pipeline for a substantial healthcare enterprise.

SQL 52

SQL Data Warehouse Azure Cloud Data 52

Precisely

JUNE 6, 2023

Featured panelists included Sanjeev Mohan, Principal at SanjMo and former Gartner Research VP; Atif Salam, CxO Advisor & Enterprise Technologist at AWS; and Precisely Chief Technology Officer, Tendü Yogurtçu, Ph.D. The group kicked off the session by exchanging ideas about what it means to have a modern data architecture.

Data Observability 52

Data Observability Data Lakes Data Quality ETL 52

Alation

MARCH 1, 2022

Airline Reporting Corporation (ARC) sells data products to travel agencies and airlines. Lineage helps them identify the source of bad data to fix the problem fast. Manual lineage will give ARC a fuller picture of how data was created between AWS S3 data lake, Snowflake cloud data warehouse and Tableau (and how it can be fixed).

Data Warehouse 52

Data Warehouse Data Lakes Cloud Data Database 52

Alation

MARCH 21, 2023

What are common data challenges for the travel industry? Some companies struggle to optimize their data’s value and leverage analytics effectively. When companies lack a data governance strategy , they may struggle to identify all consumer data or flag personal data as subject to compliance audits.

Analytics 52

Analytics Analytics Data Silos Big Data 52

The MLOps Blog

JUNE 27, 2023

For example, if you use AWS, you may prefer Amazon SageMaker as an MLOps platform that integrates with other AWS services. SageMaker Studio offers built-in algorithms, automated model tuning, and seamless integration with AWS services, making it a powerful platform for developing and deploying machine learning solutions at scale.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

DagsHub

OCTOBER 23, 2024

To combine the collected data, you can integrate different data producers into a data lake as a repository. A central repository for unstructured data is beneficial for tasks like analytics and data virtualization. Data Cleaning The next step is to clean the data after ingesting it into the data lake.

Machine Learning 52

Machine Learning Machine Learning Data Lakes AI 52

DagsHub

FEBRUARY 29, 2024

Data preparation involves multiple processes, such as setting up the overall data ecosystem, including a data lake and feature store, data acquisition and procurement as required, data annotation, data cleaning, data feature processing and data governance.

Data Preparation 52

Data Preparation Machine Learning Machine Learning Data Governance 52

Alation

MARCH 22, 2022

IDF works natively on cloud platforms like AWS. It leverages the power of serverless (and managed) services to automate and build data and analytics pipelines; IDF uses a point-and-click, zero-code approach with pipeline blueprints (patterns), such as the one below.

DataOps 52

DataOps Data Pipeline Data Engineering Data Engineering 52

Alation

JUNE 7, 2023

So, ARC worked to make data more accessible across domains while capturing tribal knowledge in the data catalog; this reduced the subject-matter-expertise bottlenecks during product development and accelerated higher quality analysis. In addition to an AWS S3 Data Lake and Snowflake Data Cloud, ARC also chose Alation Data Catalog.

Data Silos 52

Data Silos Data Lakes Data Governance Business Intelligence 52

ODSC - Open Data Science

JANUARY 18, 2024

So as you take inventory of your existing skill set, you’ll want to start to identify the areas where you need to focus on to become a data engineer. These areas may include SQL, database design, data warehousing, distributed systems, cloud platforms (AWS, Azure, GCP), and data pipelines. Learn more about the cloud.

Data Engineering 52

Data Engineering Data Engineering Data Engineer Data Engineering 52

Data Science Blog

MAY 15, 2023

tl;dr Ein Data Lakehouse ist eine moderne Datenarchitektur, die die Vorteile eines Data Lake und eines Data Warehouse kombiniert. Die Definition eines Data Lakehouse Ein Data Lakehouse ist eine moderne Datenspeicher- und -verarbeitungsarchitektur, die die Vorteile von Data Lakes und Data Warehouses vereint.

Data Warehouse 147

Data Warehouse Data Lakes Azure AWS 147

AWS Machine Learning Blog

NOVEMBER 12, 2024

This post describes how Agmatix uses Amazon Bedrock and AWS fully featured services to enhance the research process and development of higher-yielding seeds and sustainable molecules for global agriculture. AWS generative AI services provide a solution In addition to other AWS services, Agmatix uses Amazon Bedrock to solve these challenges.

AWS 118

AWS AI AI Data Lakes 118

AWS Machine Learning Blog

OCTOBER 11, 2024

With the Amazon Bedrock serverless experience, you can experiment with and evaluate top foundation models (FMs) for your use cases, privately customize them with your data using techniques such as fine-tuning and RAG, and build agents that run tasks using enterprise systems and data sources. On the Domains page, open your domain.

Database 105

Database AWS Clustering Data Lakes 105