AWS Machine Learning Blog

DECEMBER 12, 2023

In this post, we’ll summarize training procedure of GPT NeoX on AWS Trainium , a purpose-built machine learning (ML) accelerator optimized for deep learning training. M tokens/$) trained such models with AWS Trainium without losing any model quality. We’ll outline how we cost-effectively (3.2

AWS 91

AWS Deep Learning Deep Learning Machine Learning 91

AWS Machine Learning Blog

APRIL 1, 2024

Machine learning (ML) research has proven that large language models (LLMs) trained with significantly large datasets result in better model quality. Distributed model training requires a cluster of worker nodes that can scale.

Clustering 97

Clustering AWS ML ML 97

Flipboard

AUGUST 17, 2023

Many practitioners are extending these Redshift datasets at scale for machine learning (ML) using Amazon SageMaker , a fully managed ML service, with requirements to develop features offline in a code way or low-code/no-code way, store featured data from Amazon Redshift, and make this happen at scale in a production environment.

ML 93

ML ML AWS Data Warehouse 93

AWS Machine Learning Blog

JANUARY 17, 2024

Today, we’re excited to announce the availability of Llama 2 inference and fine-tuning support on AWS Trainium and AWS Inferentia instances in Amazon SageMaker JumpStart. In this post, we demonstrate how to deploy and fine-tune Llama 2 on Trainium and AWS Inferentia instances in SageMaker JumpStart.

AWS 96

AWS Python Machine Learning Machine Learning 96

AWS Machine Learning Blog

APRIL 19, 2024

Our deep learning models have non-trivial requirements: they are gigabytes in size, are numerous and heterogeneous, and require GPUs for fast inference and fine-tuning. The architecture deploys a simple service in a Kubernetes pod within an EKS cluster. The following diagram illustrates the solution architecture.

Clustering 93

Clustering AI AI AWS 93

AWS Machine Learning Blog

NOVEMBER 30, 2023

The number of companies launching generative AI applications on AWS is substantial and building quickly, including adidas, Booking.com, Bridgewater Associates, Clariant, Cox Automotive, GoDaddy, and LexisNexis Legal & Professional, to name just a few. Innovative startups like Perplexity AI are going all in on AWS for generative AI.

AWS 121

AWS AI AI ML 121

Flipboard

FEBRUARY 16, 2023

Modern model pre-training often calls for larger cluster deployment to reduce time and cost. In October 2022, we launched Amazon EC2 Trn1 Instances , powered by AWS Trainium , which is the second generation machine learning accelerator designed by AWS. The following diagram shows an example.

Clustering 106

Clustering AWS Deep Learning Deep Learning 106

AWS Machine Learning Blog

APRIL 19, 2024

We are excited to announce a new version of the Amazon SageMaker Operators for Kubernetes using the AWS Controllers for Kubernetes (ACK). ACK is a framework for building Kubernetes custom controllers, where each controller communicates with an AWS service API. They are also supported by AWS CloudFormation. Release v1.2.9

AWS 91

AWS ML ML Machine Learning 91

Iguazio

JANUARY 16, 2024

This includes a data team, an analytics team, DevOps, AI/ML, and a data science team. The AI/Ml team is made up of ML engineers, data scientists and backend product engineers. The Challenge Like many organizations, the AI/ML team at Sense was finding it challenging to scale its ML operations.

ML 52

ML ML DataOps Data Scientist 52

Smart Data Collective

FEBRUARY 20, 2022

AWS (Amazon Web Services), the comprehensive and evolving cloud computing platform provided by Amazon, is comprised of infrastructure as a service (IaaS), platform as a service (PaaS) and packaged software as a service (SaaS). With its wide array of tools and convenience, AWS has already become a popular choice for many SaaS companies.

AWS 114

AWS Cloud Computing Data Lakes Database 114

AWS Machine Learning Blog

NOVEMBER 22, 2023

For decades, Amazon has pioneered and innovated machine learning (ML), bringing delightful experiences to its customers. From the earliest days, Amazon has used ML for various use cases such as book recommendations, search, and fraud detection. To use accelerators, you need a software layer to support them.

AWS 89

AWS ML ML Deep Learning 89

Iguazio

JANUARY 16, 2024

This includes a data team, an analytics team, DevOps, AI/ML, and a data science team. The AI/Ml team is made up of ML engineers, data scientists and backend product engineers. The Challenge: Scaling ML Operations Like many organizations, the AI/ML team at Sense was finding it challenging to scale its ML operations.

ML 52

ML ML DataOps Data Scientist 52

AWS Machine Learning Blog

MAY 23, 2024

By distributing experts across workers, expert parallelism addresses the high memory requirements of loading all experts on a single device and enables MoE training on a larger cluster. The following figure offers a simplified look at how expert parallelism works on a multi-GPU cluster.

Clustering 100

Clustering AWS Deep Learning Deep Learning 100

AWS Machine Learning Blog

JUNE 7, 2023

Libraries such as DeepSpeed (an open-source deep learning optimization library for PyTorch) address some of these challenges, and can help accelerate model development and training. Training setup We provisioned a managed compute cluster comprised of 16 dl1.24xlarge instances using AWS Batch. Pre-training of a 1.5-billion-parameter

AWS 65

AWS Clustering Deep Learning Deep Learning 65

AWS Machine Learning Blog

MAY 16, 2024

Therefore, we decided to introduce a deep learning-based recommendation algorithm that can identify not only linear relationships in the data, but also more complex relationships. However, it was necessary to upgrade the recommendation service to analyze each customer’s taste and meet their needs.

AWS 88

AWS ML ML Deep Learning 88

AWS Machine Learning Blog

APRIL 19, 2023

The DJL is a deep learning framework built from the ground up to support users of Java and JVM languages like Scala, Kotlin, and Clojure. With the DJL, integrating this deep learning is simple. Since 2018, our team has been developing a variety of ML models to enable betting products for NFL and NCAA football.

ML 72

ML ML Deep Learning Deep Learning 72

AWS Machine Learning Blog

APRIL 25, 2024

We provide a comprehensive guide on how to deploy speaker segmentation and clustering solutions using SageMaker on the AWS Cloud. Solution overview Amazon Transcribe is the go-to service for speaker diarization in AWS. Hugging Face is a popular open source hub for machine learning (ML) models.

AWS 89

AWS ML ML Python 89

AWS Machine Learning Blog

DECEMBER 18, 2023

Amazon SageMaker Canvas Amazon SageMaker Canvas is a visual machine learning (ML) service that enables business analysts and data scientists to build and deploy custom ML models without requiring any ML experience or having to write a single line of code. Setup the Database access and Network access.

Clustering 99

Clustering AWS Database ML 99

AWS Machine Learning Blog

JANUARY 13, 2023

To mitigate these challenges, we propose a federated learning (FL) framework, based on open-source FedML on AWS, which enables analyzing sensitive HCLS data. It involves training a global machine learning (ML) model from distributed health data held locally at different sites.

AWS 68

AWS Analytics Analytics Machine Learning 68

AWS Machine Learning Blog

JANUARY 31, 2024

Embeddings play a key role in natural language processing (NLP) and machine learning (ML). These models are based on deep learning architectures such as Transformers, which can capture the contextual information and relationships between words in a sentence more effectively. Why do we need an embeddings model?

Natural Language Processing 104

Natural Language Processing AWS Machine Learning Machine Learning 104

AWS Machine Learning Blog

MAY 8, 2023

SageMaker provides single model endpoints (SMEs), which allow you to deploy a single ML model, or multi-model endpoints (MMEs), which allow you to specify multiple models to host behind a logical endpoint for higher resource utilization. TensorRT is an SDK developed by NVIDIA that provides a high-performance deep learning inference library.

ML 80

ML ML Deep Learning Deep Learning 80

Flipboard

MARCH 9, 2023

In this post, we review the technical requirements and application design considerations for fine-tuning and serving hyper-personalized AI models at scale on AWS. Second, SageMaker supports unique GPU-enabled hosting options for deploying deep learning models at scale.

AWS 106

AWS AI AI ML 106

AWS Machine Learning Blog

NOVEMBER 16, 2023

This is a joint blog with AWS and Philips. Since 2014, the company has been offering customers its Philips HealthSuite Platform, which orchestrates dozens of AWS services that healthcare and life sciences companies use to improve patient care.

AWS 83

AWS ML ML AI 83

AWS Machine Learning Blog

MARCH 2, 2023

Hyperparameter optimization is highly computationally demanding for deep learning models. In our solution, we implement a hyperparameter grid search on an EKS cluster for tuning a bert-base-cased model for classifying positive or negative sentiment for stock market data headlines. The code can be found on the GitHub repo.

Clustering 73

Clustering AWS Deep Learning Deep Learning 73

Data Science Dojo

AUGUST 24, 2023

ML models have grown significantly in recent years, and businesses increasingly rely on them to automate and optimize their operations. However, managing ML models can be challenging, especially as models become more complex and require more resources to train and deploy. What is MLOps?

Machine Learning 195

Machine Learning Machine Learning ML ML 195

AWS Machine Learning Blog

MARCH 6, 2023

These factors require training an LLM over large clusters of accelerated machine learning (ML) instances. In the past few years, numerous customers have been using the AWS Cloud for LLM training. SageMaker-managed clusters of ml.p4d.24xlarge

AWS 75

AWS Clustering ML ML 75

AWS Machine Learning Blog

MAY 30, 2023

In 2021, we launched AWS Support Proactive Services as part of the AWS Enterprise Support plan. Since its introduction, we’ve helped hundreds of customers optimize their workloads, set guardrails, and improve the visibility of their machine learning (ML) workloads’ cost and usage.

AWS 66

AWS Deep Learning Deep Learning ML 66

ODSC - Open Data Science

MARCH 27, 2023

You’ll hear how declarative machine learning has been essential to the speedy adoption at leading institutions such as Apple and Meta, as well as learn about Ludwig, the open-source declarative machine learning framework. Botnets Detection at Scale — Lesson Learned from Clustering Billions of Web Attacks into Botnets.

Machine Learning 98

Machine Learning Machine Learning ML ML 98

AWS Machine Learning Blog

SEPTEMBER 7, 2023

Since then, this feature has been integrated into many of our managed Amazon Machine Images (AMIs), such as the Deep Learning AMI and the AWS ParallelCluster AMI. Prerequisites To simplify reproducing the entire stack from this post, we use a container that has all the required tooling (aws cli, eksctl, helm, etc.)

Clustering 83

Clustering AWS Machine Learning Machine Learning 83

AWS Machine Learning Blog

FEBRUARY 13, 2024

The BigBasket team was running open source, in-house ML algorithms for computer vision object recognition to power AI-enabled checkout at their Fresho (physical) stores. Their objective was to fine-tune an existing computer vision machine learning (ML) model for SKU detection. Log model training metrics.

AWS 94

AWS AI AI ML 94

AWS Machine Learning Blog

JANUARY 9, 2023

Machine learning (ML) applications are complex to deploy and often require the ability to hyper-scale, and have ultra-low latency requirements and stringent cost budgets. Deploying ML models at scale with optimized cost and compute efficiencies can be a daunting and cumbersome task. Design patterns for building ML applications.

ML 72

ML ML AWS Deep Learning 72

The MLOps Blog

AUGUST 11, 2023

There comes a time when every ML practitioner realizes that training a model in Jupyter Notebook is just one small part of the entire project. At that point, the Data Scientists or ML Engineers become curious and start looking for such implementations. What are ML pipeline architecture design patterns?

ML 52

ML ML Machine Learning Machine Learning 52

AWS Machine Learning Blog

AUGUST 24, 2023

Today, we’re pleased to announce the preview of Amazon SageMaker Profiler , a capability of Amazon SageMaker that provides a detailed view into the AWS compute resources provisioned during training deep learning models on SageMaker. Framework Version AWS DLC Image URI PyTorch 2.0.0 and 1.13.1) and 2.11.1). 763104351884.dkr.ecr.amazonaws.com/pytorch-training:2.0.0-gpu-py310-cu118-ubuntu20.04-sagemaker

AWS 75

AWS Deep Learning Deep Learning ML 75

AWS Machine Learning Blog

DECEMBER 5, 2023

Walkthrough AWS-optimized AllGather AWS-optimized AllGather uses the following techniques to achieve better performance on AWS infrastructure compared to NCCL: We move data between instances via Elastic Fabric Adapter (EFA) network with an all-to-all communication pattern. 24xlarge nodes (512 NVIDIA A100 GPUs) PyTorch FSDP 97.89

AWS 79

AWS Deep Learning Deep Learning Clustering 79

AWS Machine Learning Blog

APRIL 12, 2023

The AI and data science team dive into a plethora of multi-dimensional data and run a variety of use cases like player journey optimization, game action detection, hyper-personalization, customer 360, and more on AWS. Solution overview The following diagram illustrates the solution architecture.

AWS 76

AWS ML ML Deep Learning 76

AWS Machine Learning Blog

OCTOBER 16, 2023

As an AI-powered solution, Veriff needs to create and run dozens of machine learning (ML) models in a cost-effective way. These models range from lightweight tree-based models to deep learning computer vision models, which need to run on GPUs to achieve low latency and improve the user experience.

Data Scientist 79

Data Scientist ML ML AWS 79

AWS Machine Learning Blog

JANUARY 6, 2023

Many AWS media and entertainment customers license IMDb data through AWS Data Exchange to improve content discovery and increase customer engagement and retention. We downloaded the data from AWS Data Exchange and processed it in AWS Glue to generate KG files. Background.

AWS 81

AWS ML ML Machine Learning 81