Data Science Dojo

AUGUST 28, 2023

From data management to model fine-tuning, LLMOps ensures efficiency, scalability, and risk mitigation. Similar to traditional Machine Learning Ops (MLOps), LLMOps necessitates a collaborative effort involving data scientists, DevOps engineers, and IT professionals. What is LLMOps?

Exploratory Data Analysis 195

Exploratory Data Analysis Data Preparation Machine Learning Machine Learning 195

IBM Journey to AI blog

MAY 6, 2024

This evolution is bound to have a transformative impact on business growth, but user and customer experiences hinge on organizations’ commitment to building secured, responsible, and trustworthy technology solutions. Securing generative AI starts with governance Not knowing where to start might be the inhibitor for security action too.

AI 72

AI AI AWS 72

IBM Journey to AI blog

DECEMBER 20, 2023

Without an AI strategy, organizations risk missing out on the benefits AI can offer. An AI strategy helps organizations address the complex challenges associated with AI implementation and define its objectives. What is an AI strategy? A successful AI strategy should act as a roadmap for this plan.

AI 78

AI AI Artificial Intelligence Artificial Intelligence 78

IBM Journey to AI blog

APRIL 19, 2024

This blog series discusses the complex tasks energy utility companies face as they shift to holistic grid asset management to manage through the energy transition. This approach provides actual real data points for ESG reporting instead of model-based assumptions, which helps reduce carbon footprint and achieve sustainability goals.

Internet of Things 92

Internet of Things Machine Learning Machine Learning AI 92

Snorkel AI

JUNE 12, 2023

They trained it on 100x the amount of data. Better data almost always has a greater impact than fancier models or algorithms in AI—and yet, data development has always been undersupported by AI formalisms and technology. In practice, data-centric operations have become one of the largest blockers to AI value realization.

AI 145

AI AI Algorithm Azure 145

Snorkel AI

JUNE 12, 2023

They trained it on 100x the amount of data. Better data almost always has a greater impact than fancier models or algorithms in AI—and yet, data development has always been undersupported by AI formalisms and technology. In practice, data-centric operations have become one of the largest blockers to AI value realization.

AI 141

AI AI Algorithm Azure 141

IBM Data Science in Practice

APRIL 4, 2023

Introduction This article shows how to monitor a model deployed on AWS Sagemaker for quality, bias and explainability, using IBM Watson OpenScale on the IBM Cloud Pak for Data platform. To build on that, we provide a Jupyter notebook coded to demonstrate how to: Fetch the demand response model endpoint from AWS Sagemaker.

AWS 130

AWS Machine Learning Machine Learning Data Science 130

AWS Machine Learning Blog

JANUARY 26, 2024

The goal of this post is to empower AI and machine learning (ML) engineers, data scientists, solutions architects, security teams, and other stakeholders to have a common mental model and framework to apply security best practices, allowing AI/ML teams to move fast without trading off security for speed.

AWS 124

AWS AI AI ML 124

Dataconomy

AUGUST 16, 2023

Today’s question is, “What does a data scientist do.” ” Step into the realm of data science, where numbers dance like fireflies and patterns emerge from the chaos of information. In this blog post, we’re embarking on a thrilling expedition to demystify the enigmatic role of data scientists.

Data Scientist 172

Data Scientist Data Science Machine Learning Machine Learning 172

Towards AI

JUNE 5, 2023

There are hundreds of blogs written on the same topic. As such, my intention with this blog is not to duplicate those definitions but rather to encourage you to question and evaluate your current ML strategy. The goal should be to automate all aspects, from data acquisition and processing to training, deployment, and monitoring.

ML 52

ML ML Data Scientist EDA 52

IBM Journey to AI blog

MARCH 27, 2024

The company is working with extremely high volumes of data and expects this situation to continue or grow. So, you’ve got a ton of assets earmarked for data storage , with many more workloads on the way. Your business isn’t expecting this data to collect dust in a vault, either. What is a hyperscale data center?

Internet of Things 107

Internet of Things Cloud Computing Artificial Intelligence Artificial Intelligence 107

IBM Journey to AI blog

FEBRUARY 12, 2024

Recognizing the need to harness real-time data, businesses are increasingly turning to event-driven architecture (EDA) as a strategic approach to stay ahead of the curve. This trend grows stronger as organizations realize the benefits that come from the power of real-time data streaming. Do you remember playing in the sandbox as a kid?

Apache Kafka 85

Apache Kafka EDA SQL Database 85

IBM Journey to AI blog

FEBRUARY 7, 2024

Businesses, governments and individuals now see sustainability as a global imperative. Advanced technologies, more stringent reporting standards and stronger support from stakeholders are building momentum for eco-friendly initiatives and the incentives that encourage them. trillion to the global economy by 2050.

Artificial Intelligence 97

Artificial Intelligence Artificial Intelligence Internet of Things Machine Learning 97

IBM Journey to AI blog

MARCH 20, 2024

For highly regulated industries, these challenges take on an entirely new level of expectation as they navigate evolving regulatory landscape and manage requirements for privacy, resiliency, cybersecurity, data sovereignty and more. This includes cyber incidents, technology failures, natural disasters and more. Similarly, in the U.S.

AI 79

AI AI 79

IBM Journey to AI blog

OCTOBER 16, 2023

Examples of AI bias in the real world show us that when discriminatory data and algorithms are baked into AI models, the models deploy biases at scale and amplify the resulting negative effects. Bias can be found in the initial training data, the algorithm, or the predictions the algorithm produces.

AI 75

AI AI Algorithm Artificial Intelligence 75

DataRobot

NOVEMBER 22, 2021

This is a three part blog series in partnership with Amazon Web Services describing the essential components to build, govern, and trust AI systems: People, Process and Technology. This second post is focused on building the organization-wide process for AI you can trust. There are many steps to building an AI system.

AI 52

AI AI Data Scientist Machine Learning 52

Pickl AI

OCTOBER 19, 2023

Data quality plays a significant role in helping organizations strategize their policies that can keep them ahead of the crowd. Hence, companies need to adopt the right strategies that can help them filter the relevant data from the unwanted ones and get accurate and precise output.

Data Quality 52

Data Quality Data Governance Data Warehouse Machine Learning 52

Alation

JANUARY 26, 2023

Data is a key asset for businesses in the modern world. Used correctly, it can improve internal operations, power marketing strategies, and much more. That’s why many organizations invest in technology to improve data processes, such as a machine learning data pipeline. This is why data also needs to be compliant.

Data Governance 52

Data Governance Data Engineering Data Engineer Data Engineering 52

IBM Journey to AI blog

APRIL 24, 2024

An online retailer always gets users’ explicit consent before sharing customer data with its partners. A navigation app anonymizes activity data before analyzing it for travel trends. One cannot overstate the importance of data privacy for businesses today. The user can accept or reject each use of their data individually.

Data Governance 86

Data Governance AI AI Artificial Intelligence 86

DagsHub

FEBRUARY 29, 2024

Introduction Machine learning models learn patterns from data and leverage the learning, captured in the model weights, to make predictions on new, unseen data. Data, is therefore, essential to the quality and performance of machine learning models. In this blog, I will describe how to prepare data for machine learning in depth.

Data Preparation 52

Data Preparation Machine Learning Machine Learning Data Governance 52

Alation

MARCH 14, 2023

Data gathering and use pervades almost every business function these days — and it’s widely acknowledged that businesses with a clear strategy around data are best placed to succeed in competitive, challenging markets such as defence. What is a data strategy? Why is a data strategy important?

Data Quality 52

Data Quality Data Governance Data Analysis Data Analysis 52

IBM Journey to AI blog

DECEMBER 14, 2023

In this blog, we will explore the concept of cyber resiliency from an IBM® perspective and how our approach can help organizations protect themselves in an ever-changing cybersecurity landscape. It recognizes that breaches are inevitable and places equal emphasis on prevention, detection, response and recovery.

Data Governance 85

Data Governance Machine Learning Machine Learning Analytics 85

phData

JUNE 14, 2023

In recent years, data engineering teams working with the Snowflake Data Cloud platform have embraced the continuous integration/continuous delivery (CI/CD) software development process to develop data products and manage ETL/ELT workloads more efficiently. What Are the Benefits of CI/CD Pipeline For Snowflake?

Data Pipeline 52

Data Pipeline Database SQL Data Engineering 52

Alation

APRIL 18, 2023

For any data user in an enterprise today, data profiling is a key tool for resolving data quality issues and building new data solutions. In this blog, we’ll cover the definition of data profiling, top use cases, and share important techniques and best practices for data profiling today.

Data Profiling 52

Data Profiling Data Quality Data Governance Data Pipeline 52

IBM Journey to AI blog

JANUARY 5, 2023

Poor data quality is one of the top barriers faced by organizations aspiring to be more data-driven. Ill-timed business decisions and misinformed business processes, missed revenue opportunities, failed business initiatives and complex data systems can all stem from data quality issues.

Data Quality 52

Data Quality Data Lakes Data Warehouse Business Intelligence 52

Precisely

MARCH 12, 2024

Your competitors use data to target your customers, discover unmet needs, and explore new markets. If you’re not using data to your advantage, you risk falling behind the rest of the pack. Specifically, these leaders were focused on growing their revenue and increasing operational efficiency with advanced data analytics.

Data Quality 52

Data Quality ETL Database Analytics 52

AWS Machine Learning Blog

NOVEMBER 22, 2023

The IDP Well-Architected Lens is intended for all AWS customers who use AWS to run intelligent document processing (IDP) solutions and are searching for guidance on how to build secure, efficient, and reliable IDP solutions on AWS.

AWS 85

AWS ML ML Machine Learning 85

Iguazio

MARCH 31, 2024

In this blog post, we dive deep into these use cases and their business and operational impact. For more details on this topic, you can watch the webinar this blog post is based on. Investing in employee excellence , capability building and upskilling as a key to organizational success, How Will Gen AI Impact Customer Care?

AI 52

AI AI Database Analytics 52

IBM Journey to AI blog

APRIL 6, 2023

This new regulation applies to any “automated employment tool;” so, any computational process derived from machine learning, statistical modeling, data analytics, or artificial intelligence, including homegrown and third-party programs. A holistic approach to AI governance can help. Washington, D.C.

AI 57

AI AI Artificial Intelligence Artificial Intelligence 57

IBM Journey to AI blog

FEBRUARY 5, 2024

It mandates that all financial institutions within its scope build the necessary digital operational resilience, emphasizing a tailored approach for each organization. According to Article 6 of the draft RTS, data encryption is deemed essential throughout the entire data lifecycle, covering data at rest, in transit, and in use.

AI 73

AI AI 73

IBM Journey to AI blog

FEBRUARY 13, 2024

Where tactical sourcing is a short-term strategy, strategic sourcing is for long-term business goals. Such analysis and decision-making are often optimized with the help of various technologies, including artificial intelligence tools and data analytics platforms. And from that group, 71% would pay a premium for it.

Artificial Intelligence 85

Artificial Intelligence Artificial Intelligence AI AI 85

AWS Machine Learning Blog

FEBRUARY 29, 2024

Knowledge Bases for Amazon Bedrock allows you to build performant and customized Retrieval Augmented Generation (RAG) applications on top of AWS and third-party vector stores using both AWS and third-party models. RAG is a popular technique that combines the use of private data with large language models (LLMs).

AWS 115

AWS Machine Learning Machine Learning ML 115

IBM Journey to AI blog

JUNE 12, 2023

People analytics is at the center of human resources (HR) strategy and planning. Companies rely heavily on data and analytics to find and retain talent, drive engagement, improve productivity and more across enterprise talent management. According to a Gartner report , poor data quality costs organizations an average of USD 12.9

Data Quality 67

Data Quality Data Governance Analytics Analytics 67

Alation

SEPTEMBER 9, 2021

Banks collect and manage a lot of sensitive data. And, the data collection doesn’t stop there — rich insights like transactions and purchasing information help to round out customer profiles. Data is both the enabler and the competitive advantage behind these experiences.” — Satyen Sangani, CEO and co-founder, Alation.

Data Governance 52

Data Governance Data Silos Analytics Analytics 52

Towards AI

SEPTEMBER 27, 2023

Experiments, Model Training & Evaluation: Exploring 6 Key MLOps Questions using AWS SageMaker This article is part of the AWS SageMaker series for exploration of ’31 Questions that Shape Fortune 500 ML Strategy’. Governance & Compliance] How do you track the model boundaries allowing you to explain the model decisions and detect bias?

AWS 62

AWS Data Scientist Algorithm Data Quality 62

Iguazio

FEBRUARY 20, 2024

While building gen AI application pilots is fairly straightforward, scaling them to production-ready, customer-facing implementations is a novel challenge for enterprises, and especially for the financial services sector. View the entire webinar here. What is the Potential Value of Gen AI and Analytics for Financial Services?

AI 52

AI AI Data Pipeline Data Quality 52

AWS Machine Learning Blog

MAY 23, 2023

This is a guest blog post co-written with Vik Pant and Kyle Bassett from PwC. With organizations increasingly investing in machine learning (ML), ML adoption has become an integral part of business transformation strategies. Many organizations start their journey into the world of ML with a model-centric viewpoint.

Machine Learning 75

Machine Learning Machine Learning AWS ML 75