The MLOps Blog

FEBRUARY 22, 2024

TL;DR: In many machine-learning projects, the model has to frequently be retrained to adapt to changing data or to personalize it. Continual learning is a set of approaches to train machine learning models incrementally, using data samples only once as they arrive. Consider a fraud detection model for bank transfers.

ML 59

ML ML Machine Learning Machine Learning 59

Google Research AI blog

JUNE 6, 2023

Design space for augmenting verbal communication with dynamic visuals We invited 10 internal participants, each with various technical and non-technical backgrounds, including software engineers, researchers, UX designers, visual artists, students, etc., Examples of visual intent predictions by our model.

Deep Learning 69

Deep Learning Deep Learning 69

AWS Machine Learning Blog

DECEMBER 4, 2023

In this post, we explain how we built an end-to-end product category prediction pipeline to help commercial teams by using Amazon SageMaker and AWS Batch , reducing model training duration by 90%. An effective solution to this problem is the prediction of product categories. SageMaker is a fully managed ML service.

AWS 94

AWS ML ML Predictive Analytics 94

The MLOps Blog

OCTOBER 3, 2023

Mikiko is a very well-known figure in the data community. So I tell people honestly, I’ve spent the last eight years working up and down the data and ML value chain effectively – a fancy way of saying “job hopping.” How to transition from data analytics to MLOps engineering Piotr: Miki, you’ve been a data scientist, right?

ML 52

ML ML Data Scientist Machine Learning 52

AWS Machine Learning Blog

MAY 15, 2023

Solution overview Six people from Getir’s data science team and infrastructure team worked together on this project. Next, a feature processing job prepares daily features stored in Amazon Redshift and unloads the time series data to Amazon Simple Storage Service (Amazon S3). The following diagram shows the solution’s architecture.

Algorithm 68

Algorithm Data Scientist AWS Machine Learning 68

AWS Machine Learning Blog

NOVEMBER 30, 2023

Reports holistically summarize each evaluation in a human-readable way, through natural-language explanations, visualizations, and examples, focusing annotators and data scientists on where to optimize their LLMs and help make informed decisions. The evaluation measures the percentage of correct answers overall and per category.

Algorithm 88

Algorithm AWS ML ML 88

The MLOps Blog

JUNE 27, 2023

Alignment to other tools in the organization’s tech stack Consider how well the MLOps tool integrates with your existing tools and workflows, such as data sources, data engineering platforms, code repositories, CI/CD pipelines, monitoring systems, etc. For example, neptune.ai and Pandas or Apache Spark DataFrames.

Machine Learning 134

Machine Learning Machine Learning ML ML 134

The MLOps Blog

MAY 17, 2023

From data processing to quick insights, robust pipelines are a must for any ML system. Often the Data Team, comprising Data and ML Engineers , needs to build this infrastructure, and this experience can be painful. What is an ETL data pipeline in ML? What is an ETL data pipeline in ML?

ETL 59

ETL Data Pipeline ML ML 59

AWS Machine Learning Blog

OCTOBER 10, 2023

Machine learning (ML), especially deep learning, requires a large amount of data for improving model performance. Customers often need to train a model with data from different regions, organizations, or AWS accounts. In this blog, you will learn to build a cloud-native FL architecture on AWS.

AWS 92

AWS ML ML Algorithm 92

AWS Machine Learning Blog

FEBRUARY 5, 2024

HSR.health is a geospatial health risk analytics firm whose vision is that global health challenges are solvable through human ingenuity and the focused and accurate application of data analytics. Predictive modeling using historical geospatial data allows organizations to identify and prepare for potential future events.

ML 82

ML ML AWS Support Vector Machines 82

phData

DECEMBER 4, 2023

This blog was originally written by Erik Hyrkas and updated for 2024 by Justin Delisi This isn’t meant to be a technical how-to guide — most of those details are readily available via a quick Google search — but rather an opinionated review of key processes and potential approaches. Congratulations! Want to save this guide for later?

Clustering 98

Clustering Database SQL Data Pipeline 98

AWS Machine Learning Blog

MARCH 29, 2023

Predictive quality comprises the use of ML methods in production to estimate and classify product-related quality based on manufacturing process data with the following goals[1]: Quality description – The identification of relationships between process variables and product quality. Two types of data sources exist for this use case.

AWS 75

AWS ML ML Machine Learning 75

The MLOps Blog

MAY 10, 2023

These practices are needed for a number of reasons: Backup: A trained model can be saved as a backup in case the original data is damaged or destroyed. The model registry is a category of tools that solve this issue for you. Cons of the Python Pickle Approach 1 If you unpickle untrusted data, pickling could pose a security threat.

Python 105

Python ML ML Database 105

The MLOps Blog

OCTOBER 20, 2023

Jupyter notebooks have been one of the most controversial tools in the data science community. Nevertheless, many data scientists will agree that they can be really valuable – if used well. I’ll show you best practices for using Jupyter Notebooks for exploratory data analysis.

SQL 52

SQL Database Data Scientist Python 52

O'Reilly Media

NOVEMBER 28, 2023

AI users say that AI programming (66%) and data analysis (59%) are the most needed skills. Given the cost of equipping a data center with high-end GPUs, they probably won’t attempt to build their own infrastructure. Few nonusers (2%) report that lack of data or data quality is an issue, and only 1.3%

AI 108

AI AI Data Analysis Data Analysis 108

AWS Machine Learning Blog

MAY 2, 2023

With the ability to solve various problems such as classification and regression, XGBoost has become a popular option that also falls into the category of tree-based models. Triton supports various backends as engines to support the running and serving of various ML models for inference. We suggest starting with storage_type.

ML 64

ML ML Python Machine Learning 64

AWS Machine Learning Blog

MAY 9, 2023

Triton supports various backends as engines to support the running and serving of various ML models for inference. Various use cases fall into this category, such as preprocessing or postprocessing steps composing a model ensemble. decode("utf8")) output_ids = np.array(response_body["outputs"][0]["data"]).reshape(batch_size,

Python 81

Python ML ML Deep Learning 81

The MLOps Blog

MAY 9, 2023

One of the most prevalent complaints we hear from ML engineers in the community is how costly and error-prone it is to manually go through the ML workflow of building and deploying models. Building end-to-end machine learning pipelines lets ML engineers build once, rerun, and reuse many times. If all goes well, of course ?

ML 98

ML ML Machine Learning Machine Learning 98

AWS Machine Learning Blog

JANUARY 9, 2023

Strict service level agreements (SLAs) need to be met, and a typical request may require multiple steps such as preprocessing, data transformation, feature engineering, model selection logic, model aggregation, and postprocessing. Do you have many models trained for different subsets of data for the same use case?

ML 74

ML ML AWS Deep Learning 74