Alation

JULY 30, 2021

6 Business Problems Data Catalogs Solve. The question I ask now is: What business problems does a data catalog solve for business customers? 1: Biz Problem – Making Data Accessible & Scalable in the Cloud. A part of that journey often involves moving fragmented on-premises data to a cloud data warehouse.

Data Warehouse 52

Data Warehouse Data Governance Cloud Data Machine Learning 52

Alation

SEPTEMBER 7, 2021

This is the last of the 4-part blog series. In the previous blog , we discussed how Alation provides a platform for data scientists and analysts to complete projects and analysis at speed. In this blog we will discuss how Alation helps minimize risk with active data governance. Meet Governance Requirements.

Data Governance 59

Data Governance Data Scientist Data Quality Data Profiling 59

Alation

MAY 24, 2022

In a sea of questionable data, how do you know what to trust? Data quality tells you the answer. It signals what data is trustworthy, reliable, and safe to use. It empowers engineers to oversee data pipelines that deliver trusted data to the wider organization. It affects everyone who produces and consumes data.

Data Quality 52

Data Quality Data Pipeline DataOps Analytics 52

AWS Machine Learning Blog

SEPTEMBER 1, 2023

Specifically, we briefly introduce MLOps principles and focus on the main differentiators compared to FMOps and LLMOps regarding processes, people, model selection and evaluation, data privacy, and model deployment. These data owners are focused on providing access to their data to multiple business units or teams.

AI 103

AI AI ML ML 103

IBM Journey to AI blog

APRIL 24, 2024

An online retailer always gets users’ explicit consent before sharing customer data with its partners. A navigation app anonymizes activity data before analyzing it for travel trends. One cannot overstate the importance of data privacy for businesses today. The user can accept or reject each use of their data individually.

Data Governance 87

Data Governance AI AI Artificial Intelligence 87

Alation

FEBRUARY 3, 2022

The goal of DataOps is to create predictable delivery and change management of data and all data-related artifacts. DataOps practices help organizations overcome challenges caused by fragmented teams and processes and delays in delivering data in consumable forms. So how does data governance relate to DataOps?

Data Governance 98

Data Governance DataOps Data Quality Machine Learning 98

Alation

FEBRUARY 13, 2020

In a recent blog, titled Collaboration and Crowdsourcing with Data Cataloging , I discussed the importance of participation by all data stakeholders as a key to getting maximum value from your data catalog. This build-it-and-they-will-come approach fails to engage people to actively use the catalog.

Data Governance 52

Data Governance Data Analysis Data Analysis Data Preparation 52

AWS Machine Learning Blog

SEPTEMBER 7, 2023

Offline reinforcement learning is a control strategy that allows industrial companies to build control policies entirely from historical data without the need for an explicit process model. In offline reinforcement learning, one can train a policy on historical data before deploying it into production.

AWS 94

AWS Machine Learning Machine Learning Natural Language Processing 94

IBM Journey to AI blog

APRIL 4, 2024

Lots of innovation is happening, with new technologies emerging in areas such as data and AI, payments, cybersecurity and risk management, to name a few. The assessment is designed to help ISVs identify gaps in their cloud architecture and recommend best practices to enhance the compliance and governance of their cloud environment.

AI 60

AI AI 60

Alation

MARCH 17, 2022

Is your private data used compliantly? Indeed, every organization that collects and manages data must ensure responsible data usage and appropriate cybersecurity measures are in place. Ensuring Cloud Migration Data Security Is Essential. Ensuring cloud migration data security is essential. They are imperatives.

52

52

Alation

SEPTEMBER 27, 2021

I wrote blog posts, but my mentors also encouraged me to study the performance analytics to inform the direction of future blog content. Alation mentors effectively bridge the gap between education and trust in a way that makes sense to you and activates your potential for immediate results. Subscribe to Alation's Blog.

Analytics 52

Analytics Analytics 52

Alation

OCTOBER 7, 2021

Jason McVay is a data scientist at Indigo Ag, an agriculture-tech company headquartered in Massachusetts. In this essay, Jason reflects on the value of thinking spatially about data, showing how his experience as a graduate student influences his role as a data scientist today. The rise of spatial data. It is essential.

Data Scientist 98

Data Scientist Data Lakes Data Science SQL 98

Smart Data Collective

JUNE 28, 2021

E-commerce companies around the world are investing more in data centers than ever before. The benefits of data centers for e-commerce companies are undeniable. They give online retailers high levels of control over their own internal data. E-commerce companies are using a lot of great data centers and hosting options.

Big Data 87

Big Data Big Data Big Data Analytics Big Data Analytics 87

Alation

SEPTEMBER 14, 2021

The importance of data governance is growing. This will enable you to choose exactly the right mix of data catalog plus apps that best meet your business needs. Alation Data Governance App. The Data Governance App introduces a range of new capabilities to make governance more easy and effective.

Data Governance 52

Data Governance DataOps Machine Learning Machine Learning 52

Alation

JANUARY 26, 2023

Data is a key asset for businesses in the modern world. That’s why many organizations invest in technology to improve data processes, such as a machine learning data pipeline. However, data needs to be easily accessible, usable, and secure to be useful — yet the opposite is too often the case.

Data Governance 52

Data Governance Data Engineering Data Engineer Data Engineering 52

IBM Journey to AI blog

DECEMBER 19, 2023

The first post in this series navigates the complexities and uncovers the strategies and target state mode for achieving a seamless and effective pathway to deploy. Stage 3: Self-service and cross-functional integration Enterprises have many organizations that want to see that cloud applications follow their guidance and best practices.

AWS 82

AWS Data Classification Data Preparation 82

Snorkel AI

AUGUST 9, 2023

In this blog post, we walk through an anonymized real-world use case comparing a variety of state-of-the-art LLMs (GPT 4, GPT 3.5, In this blog post, we walk through an anonymized real-world use case comparing a variety of state-of-the-art LLMs (GPT 4, GPT 3.5, Serged on all sides for durability. Made in the USA. We needed to iterate!

Artificial Intelligence 52

Artificial Intelligence Artificial Intelligence AI AI 52

Snorkel AI

AUGUST 9, 2023

In this blog post, we walk through an anonymized real-world use case comparing a variety of state-of-the-art LLMs (GPT 4, GPT 3.5, In this blog post, we walk through an anonymized real-world use case comparing a variety of state-of-the-art LLMs (GPT 4, GPT 3.5, Serged on all sides for durability. Made in the USA. We needed to iterate!

Artificial Intelligence 52

Artificial Intelligence Artificial Intelligence AI AI 52

IBM Journey to AI blog

JUNE 14, 2023

You need to collect, curate, and annotate data for any specific task you want to perform. With a foundation model, often using a kind of neural network called a “transformer” and leveraging a technique called self-supervised learning, you can create pre-trained models for a vast amount of unlabeled data.

AI 93

AI AI Natural Language Processing Data Lakes 93

Alation

SEPTEMBER 28, 2022

The term has been used a lot more of late, especially in the data analytics industry, as we’ve seen it expand over the past few years to keep pace with new regulations, like the GDPR and CCPA. In essence, DataOps is a practice that helps organizations manage and govern data more effectively. What Is DataOps?

DataOps 52

DataOps Data Pipeline Data Quality Analytics 52

IBM Journey to AI blog

DECEMBER 19, 2023

As practices like DevOps , cloud native , serverless and site reliability engineering (SRE) mature, the focus is shifting toward significant levels of automation, speed, agility and business alignment with IT (which helps enterprise IT transform into engineering organizations). Interventions only by exceptions.

Data Classification 71

Data Classification 71

Alation

MARCH 29, 2022

Today, the term describes that same activity, but on a much larger scale, as organizations race to collect, analyze, and act on data first. But there have always been limits on who can access valuable data, as well as how it can be used. In the 1970s, data was confined to mainframes and primitive databases.

Business Intelligence 96

Business Intelligence Business Intelligence Data Silos Citizen Data Scientist 96

Alation

MAY 10, 2022

magazine’s annual list of the Best Workplaces for the third time! Becoming a Best Workplace. Being rated as a best company to work for isn’t easy in these oh-so-challenging times. It’s also my job to put our culture into practice and to ensure that we create an environment where we support our customers and our people.

Data Governance 52

Data Governance Business Intelligence Business Intelligence 52

Alation

OCTOBER 5, 2021

What is data governance and how do you measure success? Data governance is a system for answering core questions about data. It begins with establishing key parameters: What is data, who can use it, how can they use it, and why? Why is your data governance strategy failing? Common data governance challenges.

Data Governance 96

Data Governance Data Quality Data Silos Analytics 96

IBM Journey to AI blog

FEBRUARY 2, 2023

In today’s world, data warehouses are a critical component of any organization’s technology ecosystem. The rise of cloud has allowed data warehouses to provide new capabilities such as cost-effective data storage at petabyte scale, highly scalable compute and storage, pay-as-you-go pricing and fully managed service delivery.

Data Warehouse 57

Data Warehouse Cloud Data Database Analytics 57

AWS Machine Learning Blog

NOVEMBER 16, 2023

This is a joint blog with AWS and Philips. With SageMaker MLOps tools, teams can easily train, test, troubleshoot, deploy, and govern ML models at scale to boost productivity of data scientists and ML engineers while maintaining model performance in production.

AWS 89

AWS ML ML AI 89

IBM Journey to AI blog

AUGUST 1, 2023

Organizations need to pay attention to several types of incidents, including unplanned interruptions like system outages, network configuration issues, bugs, security incidents, data loss and more. It provides a library of best practices for managing IT assets and improving IT support and service levels.

Database 62

Database Analytics Analytics 62

IBM Journey to AI blog

JULY 19, 2023

This digital data is coming at the industry in various formats, like unstructured text, images, PDFs and emails. generative AI has the potential to process digital content at scale and produce an effective MLR output, which can then be leveraged by the human marketing team, accelerating and simplifying the process.

AWS 64

AWS AI AI Machine Learning 64

AWS Machine Learning Blog

AUGUST 1, 2023

In today’s rapidly evolving healthcare landscape, doctors are faced with vast amounts of clinical data from various sources, such as caregiver notes, electronic health records, and imaging reports. Efficiently summarizing and extracting insights from this data is crucial for better patient care and decision-making.

ML 74

ML ML AWS AI 74

AWS Machine Learning Blog

APRIL 5, 2023

You want to quickly find a picture that was taken when you and your best friend were in front of your old house’s swimming pool. The concept underpinning k-NN is that similar data points exist in close proximity in the embedding space. You can use both text and images as queries. We use the first metadata file in this demo.

AWS 87

AWS ML ML K-nearest Neighbors 87

The MLOps Blog

MARCH 15, 2023

It’s clear that the need for efficient and effective MLOps and CI/CD practices is becoming increasingly vital. We’ll delve into the MLOps practices and strategies we tried and implemented across some of our projects. This is a blog post from AWS to optimize cloud services costs. S3 buckets.

AWS 52

AWS ETL ML ML 52

AWS Machine Learning Blog

JANUARY 4, 2024

One such area that is evolving is using natural language processing (NLP) to unlock new opportunities for accessing data through intuitive SQL queries. Instead of dealing with complex technical code, business users and data analysts can ask questions related to data and insights in plain language.

SQL 119

SQL Database AI AI 119

Data Science Blog

SEPTEMBER 19, 2023

In the contemporary age of Big Data, Data Warehouse Systems and Data Science Analytics Infrastructures have become an essential component for organizations to store, analyze, and make data-driven decisions. So why using IaC for Cloud Data Infrastructures? Traditional manual scaling methods are cumbersome and slow.

Data Warehouse 259

Data Warehouse Azure SQL Database 259

AWS Machine Learning Blog

FEBRUARY 28, 2024

The solution in this post aims to bring enterprise analytics operations to the next level by shortening the path to your data using natural language. Second, you might need to build text-to-SQL features for every database because data is often not stored in a single target. We use Anthropic Claude v2.1 on Amazon Bedrock as our LLM.

SQL 111

SQL AWS Database ML 111

AWS Machine Learning Blog

NOVEMBER 22, 2023

Use the “Generative AI” tag as you are browsing the session catalog to find them. Visit the session catalog to learn about all our generative AI and ML sessions. Generative AI is augmenting our productivity and creativity in new ways, while also being fueled by massive amounts of enterprise data and human intelligence.

AWS 110

AWS ML ML AI 110

AWS Machine Learning Blog

APRIL 16, 2024

Amazon SageMaker Studio provides a fully managed solution for data scientists to interactively build, train, and deploy machine learning (ML) models. In the process of working on their ML tasks, data scientists typically start their workflow by discovering relevant data sources and connecting to them.

SQL 90

SQL AWS Database Data Scientist 90

Alation

JANUARY 25, 2022

Data fabric is now on the minds of most data management leaders. In our previous blog, Data Mesh vs. Data Fabric: A Love Story , we defined data fabric and outlined its uses and motivations. The data catalog is a foundational layer of the data fabric.

DataOps 52

DataOps SQL ML ML 52