IBM Journey to AI blog

JANUARY 10, 2024

Outside the data-plane, there are still a lot of complexities that needed to be dealt with, such as lifecycle management of the gateways, certificate rotation, policy administration, and, more importantly, observability. We hope you join us on the journey.

Clustering 70

Clustering 70

ODSC - Open Data Science

MARCH 22, 2024

Be sure to check out his talk, “ Building Data Contracts with Open Source Tools ,” there! Data engineering is a critical function in all industries. However, data engineering grows exponentially as the company grows, acquires, or merges with others. The number of data sources (whether internal or external) is growing.

Data Engineering 52

Data Engineering Data Engineer Data Engineering Data Engineering 52

Dataversity

NOVEMBER 10, 2022

There are several reasons why the notion of semantic layers has reached the forefront of today’s data management conversations. The analyst community is championing the data fabric tenet. The data mesh and data lake house architectures are gaining traction. Data lakes are widely deployed.

Data Lakes 52

Data Lakes Business Intelligence Business Intelligence 52

Dataversity

SEPTEMBER 12, 2022

The ways in which we store and manage data have grown exponentially over recent years – and continue to evolve into new paradigms. For much of IT history, though, enterprise data architecture has existed as monolithic, centralized “data lakes.” The post Data Mesh or Data Mess?

Data Lakes 52

Data Lakes Data Quality Data Governance Cloud Data 52

AWS Machine Learning Blog

MARCH 11, 2024

The new VistaPrint personalized product recommendation system Figure 1 As seen in Figure 1, the steps in how VistaPrint provides personalized product recommendations with their new cloud-native architecture are: Aggregate historical data in a data warehouse. Transform the data to create Amazon Personalize training data.

AWS 95

AWS Data Warehouse Machine Learning Machine Learning 95

Alation

MARCH 31, 2023

I’m talking about not just Walt Disney World, but also this year’s Gartner Data & Analytics Summit , which took place last month in Orlando at the landmark resort. Alation was proud to have been among the thought leaders at the annual gathering of data experts from around the world. Mesh or fabric?

Analytics 52

Analytics Analytics Data Governance Power BI 52

IBM Journey to AI blog

JANUARY 5, 2023

Poor data quality is one of the top barriers faced by organizations aspiring to be more data-driven. Ill-timed business decisions and misinformed business processes, missed revenue opportunities, failed business initiatives and complex data systems can all stem from data quality issues.

Data Quality 52

Data Quality Data Lakes Data Warehouse Business Intelligence 52

Alation

FEBRUARY 8, 2022

The “data textile” wars continue! In our first blog in this series , we define the terms data fabric and data mesh. The second blog took a deeper dive into data fabric, examining its key pillars and the role of the data catalog in each. Data as a product.

Data Governance 52

Data Governance Data Engineering Data Engineer Data Engineering 52

ODSC - Open Data Science

APRIL 4, 2024

Data Analytics in the Age of AI, When to Use RAG, Examples of Data Visualization with D3 and Vega, and ODSC East Selling Out Soon Data Analytics in the Age of AI Let’s explore the multifaceted ways in which AI is revolutionizing data analytics, making it more accessible, efficient, and insightful than ever before.

Data Visualization 52

Data Visualization Analytics Analytics Big Data Analytics 52

IBM Journey to AI blog

SEPTEMBER 27, 2023

True observability requires observing and analyzing data from all layers of the system, including application metrics, traces, and infrastructure telemetry. Web applications : In web applications, observability revolves around capturing and analyzing data from different layers, such as frontend, backend and infrastructure.

Database 77

Database 77

Alation

MARCH 11, 2022

So far, we’ve considered the rivalry of data fabric versus mesh. We’ve explored what is a data fabric , what is a data mesh , and how a data catalog supports these architectures. That’s right: You can leverage a meshy fabric architecture. How to Leverage a Meshy Fabric Architecture.

Data Governance 52

Data Governance Data Quality Analytics Analytics 52

Alation

MARCH 1, 2023

How are blockchain organizations tackling data management? To learn the answer, we sat down with Karla Kirton , Data Architect at Blockdaemon, a blockchain company, to discuss data strategy , decentralization, and how implementing Alation has supported them. What is your data strategy and how did you begin to implement it?

Data Governance 52

Data Governance Data Pipeline Database Analytics 52

AWS Machine Learning Blog

SEPTEMBER 1, 2023

Specifically, we briefly introduce MLOps principles and focus on the main differentiators compared to FMOps and LLMOps regarding processes, people, model selection and evaluation, data privacy, and model deployment. These data owners are focused on providing access to their data to multiple business units or teams.

AI 104

AI AI ML ML 104

AWS Machine Learning Blog

JUNE 13, 2023

Implementing a modern data architecture provides a scalable method to integrate data from disparate sources. By organizing data by business domains instead of infrastructure, each domain can choose tools that suit their needs. However, realizing the full benefits requires overcoming some challenges.

Database 73

Database SQL AWS AI 73

phData

SEPTEMBER 20, 2023

A data mesh is a decentralized approach to data architecture that’s been gaining traction as a solution to the challenges posed by large and complex data ecosystems. And when it comes to implementing a data mesh, one platform has been making waves in the data world: the Snowflake Data Cloud.

Data Silos 52

Data Silos Database Data Quality Data Engineering 52

Alation

FEBRUARY 18, 2021

Alation has evolved a great deal since pioneering the data catalog category. Initially, Alation was a solution that made it dramatically easier to find, understand, and trust data. Now, Alation is a platform for a broad range of data intelligence use cases — from data search & discovery to data governance to cloud migration.

Data Governance 52

Data Governance Tableau AWS 52

IBM Journey to AI blog

JANUARY 18, 2023

Data platform architecture has an interesting history. A read-optimized platform that can integrate data from multiple applications emerged. In another decade, the internet and mobile started the generate data of unforeseen volume, variety and velocity. It required a different data platform solution. Guess what?

Data Lakes 52

Data Lakes Data Warehouse Azure Apache Hadoop 52

AWS Machine Learning Blog

NOVEMBER 22, 2023

24xlarge 96 8 128 GB 1.088 TB/s 768 GB 100 Gbps 19 Gbps Qualcomm Cloud AI100 accelerator innovation The Cloud AI100 accelerator system-on-chip (SoC) is a purpose-built, scalable multi-core architecture, supporting a wide range of deep-learning use-cases spanning from the datacenter to the edge. tolist()[i] val = top_5_results.values[0].tolist()[i]

AI 103

AI AI AWS Deep Learning 103

IBM Journey to AI blog

APRIL 24, 2023

The dependence on remote internet access for business, personal, and educational use elevated the data demand and boosted global data consumption. Additionally, the increase in online transactions and web traffic generated mountains of data. Enter the modernization of data warehousing solutions.

Data Warehouse 97

Data Warehouse Data Lakes Database Artificial Intelligence 97

Alation

JANUARY 13, 2022

And now, arguably the greatest rivalry the world (well, at least the data community) has ever witnessed: Data Fabric vs Data Mesh! Data fabric and data mesh are both having a moment. Gartner calls data fabric the Future of Data Management 1. Gartner on Data Fabric.

Data Lakes 59

Data Lakes Data Governance Data Quality Data Warehouse 59

Alation

AUGUST 11, 2022

DataOps sprung up to connect data sources to data consumers. Architectures became fabrics. The data warehouse and analytical data stores moved to the cloud and disaggregated into the data mesh. Data fabric, data mesh, modern data stack. Tools became stacks.

Data Warehouse 52

Data Warehouse Data Engineering Data Engineer Data Engineering 52

Dataversity

JANUARY 8, 2024

This is my monthly check-in to share with you the people and ideas I encounter as a data evangelist with DATAVERSITY. This month, we’re talking about data mesh. Data mesh represents a federated model of running your data program.

Data Governance 105

Data Governance Data Quality 105

IBM Journey to AI blog

NOVEMBER 14, 2023

Data monetization is a business capability where an organization can create and realize value from data and artificial intelligence (AI) assets. A value exchange system built on data products can drive business growth for your organization and gain competitive advantage.

AI 111

AI AI Artificial Intelligence Artificial Intelligence 111

AWS Machine Learning Blog

OCTOBER 20, 2023

However, implementing security, data privacy, and governance controls are still key challenges faced by customers when implementing ML workloads at scale. These companies also recognize the need for governance to manage things like access control, data usage, model performance, and unfair bias.

ML 103

ML ML AWS Data Lakes 103

IBM Journey to AI blog

FEBRUARY 19, 2024

Data monetization empowers organizations to use their data assets and artificial intelligence (AI) capabilities to create tangible economic value. This value exchange system uses data products to enhance business performance, gain a competitive advantage, and address industry challenges in response to market demand.

AI 69

AI AI Data Silos Data Warehouse 69

phData

OCTOBER 12, 2023

This blog was co-written by Sam Hall and Dakota Kelley In our previous blog , we discussed some ways Fivetran and dbt solve ELT for enterprise data consumption and analytics. As your data organization grows, the scalability of your data platform matters. Nothing is completely hands off, though.

Data Warehouse 52

Data Warehouse Database Cloud Data Data Pipeline 52

Dataversity

DECEMBER 14, 2023

In the fast-evolving data landscape, understanding emerging trends and embracing technological advancements are key to staying ahead. As we approach 2024, this article explores the data trends that will define the strategic landscape for the coming year.

AI 69

AI AI Data Quality Data Governance 69

AWS Machine Learning Blog

DECEMBER 6, 2023

When prompted correctly, these models can carry coherent conversations without any task-specific training data. However, they can’t generalize well to enterprise-specific questions because, to generate an answer, they rely on the public data they were exposed to during pre-training. Sort the revenues in descending order.

SQL 103

SQL AWS Database Analytics 103

Dataversity

DECEMBER 9, 2022

The post Five Data and Analytics Trends: What Lies Ahead in 2023 appeared first on DATAVERSITY. The convenience factor of digital is accelerating the pace at which businesses are applying an online presence, including the ones that were mainly brick-and-mortar before COVID.

Analytics 98

Analytics Analytics Cloud Computing 98

Dataversity

OCTOBER 26, 2022

Until immortality is invented, we’ll have to settle for solving the same problem in data enablement. Actionable data lost to time. With incredible advances in data […]. The post High-Fidelity, Persistent Data Storage and Replay appeared first on DATAVERSITY. How are we still talking about this?

Data Lakes 98

Data Lakes Data Warehouse ETL Analytics 98

Dataversity

MAY 23, 2022

Data virtualization was first introduced two decades ago. Since then, the technology has evolved considerably, and the data virtualization of yesterday bears little resemblance to the data virtualization of today.

Data Lakes 98

Data Lakes Data Warehouse 98

Dataversity

JANUARY 3, 2022

With data dependency at an all-time high for businesses, almost every industry player is looking to establish themselves as a technology company first, similar to Amazon or Netflix. The post 5 Trends That Will Enable Organizations to Leverage Data Effectively in 2022 appeared first on DATAVERSITY.

Cloud Data 98

Cloud Data Data Science Analytics Analytics 98

Dataversity

OCTOBER 18, 2021

What if data really is the fuel that powers engines of insight? The post Modern Data Integration Requires Hybrid Multicloud Data Fabric appeared first on DATAVERSITY. Imagine a world exactly like ours in every way except for one key difference. Instead of the modern fossil fuel supply chain (i.e.,

Database 98

Database ML ML Analytics 98

Dataversity

AUGUST 27, 2021

If this time 10 years ago you were working in data and analytics, something was about to happen that would go on to dominate a large part of your professional life. I’m talking about the emergence of “big data.” The post Big Data at 10: Did Bigger Mean Better? Click to learn more about author Mathias Golombek.

Big Data 98

Big Data Big Data Analytics Analytics 98

Dataversity

JUNE 26, 2023

The same expectation applies to data, […] The post Leveraging Data Pipelines to Meet the Needs of the Business: Why the Speed of Data Matters appeared first on DATAVERSITY. Today, businesses and individuals expect instant access to information and swift delivery of services.

Data Pipeline 52

Data Pipeline Data Observability Data Quality Data Governance 52

Alation

JANUARY 25, 2022

Data fabric is now on the minds of most data management leaders. In our previous blog, Data Mesh vs. Data Fabric: A Love Story , we defined data fabric and outlined its uses and motivations. The data catalog is a foundational layer of the data fabric.

DataOps 52

DataOps SQL ML ML 52

Dataversity

NOVEMBER 11, 2022

A stateful application saves data generated by each client session and uses it the next time the client makes a request. A stateless application doesn’t save client data from one session to the next. The post How a Stateless Data Architecture Can Enable You to Harness the Power of Today’s Agile Data appeared first on DATAVERSITY.

52

52