AWS Machine Learning Blog

MAY 16, 2025

This post is co-authored by Manuel Lopez Roldan, SiMa.ai, and Jason Westra, AWS Senior Solutions Architect. Prerequisites Before you get started, make sure you have the following: An AWS account. If you dont have an AWS account, you can create one. The AWS Command Line Interface (AWS CLI), Docker, and Git installed locally.

AWS 89

AWS AI AI ML 89

AWS Machine Learning Blog

JANUARY 7, 2025

To address this need, AWS generative AI best practices framework was launched within AWS Audit Manager , enabling auditing and monitoring of generative AI applications. Figure 1 depicts the systems functionalities and AWS services. Select AWS Generative AI Best Practices Framework for assessment. Choose Create assessment.

AWS 115

AWS AI AI Database 115

AWS Machine Learning Blog

NOVEMBER 26, 2024

Using vLLM on AWS Trainium and Inferentia makes it possible to host LLMs for high performance inference and scalability. Deploy vLLM on AWS Trainium and Inferentia EC2 instances In these sections, you will be guided through using vLLM on an AWS Inferentia EC2 instance to deploy Meta’s newest Llama 3.2 You will use inf2.xlarge

AWS 108

AWS AI AI Artificial Intelligence 108

Flipboard

NOVEMBER 27, 2024

In this post, we show you how to integrate the popular Slack messaging service with AWS generative AI services to build a natural language assistant where business users can ask questions of an unstructured dataset. In this solution, we have enabled the AWS provided profanity filter.

AWS 145

AWS AI AI Database 145

AWS Machine Learning Blog

FEBRUARY 11, 2025

Today, AWS AI released GraphStorm v0.4. Prerequisites To run this example, you will need an AWS account, an Amazon SageMaker Studio domain, and the necessary permissions to run BYOC SageMaker jobs. Using SageMaker Pipelines to train models provides several benefits, like reduced costs, auditability, and lineage tracking. million edges.

AWS 113

AWS Python ML ML 113

AWS Machine Learning Blog

MARCH 3, 2025

Hybrid architecture with AWS Local Zones To minimize the impact of network latency on TTFT for users regardless of their locations, a hybrid architecture can be implemented by extending AWS services from commercial Regions to edge locations closer to end users. Next, create a subnet inside each Local Zone. Amazon Linux 2).

AWS 87

AWS AI AI Deep Learning 87

AWS Machine Learning Blog

DECEMBER 16, 2024

70B through SageMaker JumpStart offers two convenient approaches: using the intuitive SageMaker JumpStart UI or implementing programmatically through the SageMaker Python SDK. Prior to joining AWS, Dr. Li held data science roles in the financial and retail industries. Adriana Simmons is a Senior Product Marketing Manager at AWS.

AWS 102

AWS ML ML Python 102

AWS Machine Learning Blog

DECEMBER 2, 2024

Today at AWS re:Invent 2024, we are excited to announce the new Container Caching capability in Amazon SageMaker, which significantly reduces the time required to scale generative AI models for inference. Container Caching addresses this scaling challenge by pre-caching the container image, eliminating the need to download it when scaling up.

AI 111

AI AI AWS Machine Learning 111

AWS Machine Learning Blog

DECEMBER 2, 2024

Today at AWS re:Invent 2024, we are excited to announce a new capability in Amazon SageMaker Inference that significantly reduces the time required to deploy and scale LLMs for inference using LMI: Fast Model Loader. To reduce the time it takes to download and load the container image, SageMaker now supports container caching.

AWS 115

AWS Machine Learning Machine Learning ML 115

AWS Machine Learning Blog

OCTOBER 18, 2024

We demonstrate this solution by walking you through a comprehensive step-by-step guide on how to fine-tune YOLOv8 , a real-time object detection model, on Amazon Web Services (AWS) using a custom dataset. Call the SageMaker control plane API using the SageMaker Python SDK for model training. An AWS account. environment.

AWS 104

AWS AI AI Machine Learning 104

AWS Machine Learning Blog

JANUARY 29, 2025

In this post, we explore how to deploy distilled versions of DeepSeek-R1 with Amazon Bedrock Custom Model Import, making them accessible to organizations looking to use state-of-the-art AI capabilities within the secure and scalable AWS infrastructure at an effective cost. You can monitor costs with AWS Cost Explorer.

AWS 135

AWS ML ML AI 135

AWS Machine Learning Blog

JULY 2, 2024

AWS optimized the PyTorch torch.compile feature for AWS Graviton3 processors. the optimizations are available in torch Python wheels and AWS Graviton PyTorch deep learning container (DLC). The goal for the AWS Graviton team was to optimize torch.compile backend for Graviton3 processors.

AWS 126

AWS Natural Language Processing Python ML 126

AWS Machine Learning Blog

MAY 2, 2024

Today, we’re excited to announce the availability of Meta Llama 3 inference on AWS Trainium and AWS Inferentia based instances in Amazon SageMaker JumpStart. In this post, we demonstrate how easy it is to deploy Llama 3 on AWS Trainium and AWS Inferentia based instances in SageMaker JumpStart.

AWS 131

AWS ML ML Python 131

AWS Machine Learning Blog

APRIL 29, 2024

For AWS and Outerbounds customers, the goal is to build a differentiated machine learning and artificial intelligence (ML/AI) system and reliably improve it over time. First, the AWS Trainium accelerator provides a high-performance, cost-effective, and readily available solution for training and fine-tuning large models.

AWS 129

AWS ML ML Python 129

AWS Machine Learning Blog

MAY 15, 2024

AWS Graviton3 processors are optimized for ML workloads, including support for bfloat16, Scalable Vector Extension (SVE), and Matrix Multiplication (MMLA) instructions. In this post, we show how to run ONNX Runtime inference on AWS Graviton3-based EC2 instances and how to configure them to use optimized GEMM kernels.

AWS 137

AWS Natural Language Processing Python Deep Learning 137

PyImageSearch

MAY 19, 2025

Jump Right To The Downloads Section Introduction In the previous post , we walked through the process of indexing and storing movie data in OpenSearch. If you havent already set up the project from the previous post, you can download the source code from the tutorials “Downloads” section. data queries_set_1.txt

K-nearest Neighbors 91

K-nearest Neighbors AWS Deep Learning Deep Learning 91

AWS Machine Learning Blog

JANUARY 27, 2025

Write a Python model definition using the SageMaker inference.py For this post, we use the us-east-1 AWS Region: Have access to a POSIX based (Mac/Linux) system or SageMaker notebooks. file format. Define your model artifacts and inference file within a specific file structure, archive your model files as a tar.gz

AWS 111

AWS Deep Learning Deep Learning Machine Learning 111

IBM Data Science in Practice

APRIL 4, 2023

Introduction This article shows how to monitor a model deployed on AWS Sagemaker for quality, bias and explainability, using IBM Watson OpenScale on the IBM Cloud Pak for Data platform. This article shows how to use the endpoint generated from that tutorial to demonstrate how to monitor the AWS deployment with Watson OpenScale.

AWS 130

AWS Machine Learning Machine Learning Data Science 130

AWS Machine Learning Blog

OCTOBER 5, 2023

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS 130

AWS Machine Learning Machine Learning Deep Learning 130

AWS Machine Learning Blog

MAY 3, 2023

AWS, Arm, Meta and others helped optimize the performance of PyTorch 2.0 As a result, we are delighted to announce that AWS Graviton-based instance inference performance for PyTorch 2.0 times the speed for BERT, making Graviton-based instances the fastest compute optimized instances on AWS for these models. is up to 3.5

AWS 112

AWS Cloud Computing Python Machine Learning 112

IBM Data Science in Practice

MARCH 8, 2023

You can then export the model and deploy it on Amazon Sagemaker on Amazon Web Server (AWS). If you are set up with the required systems, you can download the sample project and complete the steps for hands-on learning. This sample uses the following platforms: Watson Studio and Watson Machine Learning with a Python 3.9

AWS 130

AWS Machine Learning Machine Learning Algorithm 130

AWS Machine Learning Blog

OCTOBER 10, 2023

Customers often need to train a model with data from different regions, organizations, or AWS accounts. Existing partner open-source FL solutions on AWS include FedML and NVIDIA FLARE. These open-source packages are deployed in the cloud by running in virtual machines, without using the cloud-native services available on AWS.

AWS 124

AWS ML ML Algorithm 124

AWS Machine Learning Blog

MAY 14, 2025

You can execute each step in the training pipeline by initiating the process through the SageMaker control plane using APIs, AWS Command Line Interface (AWS CLI), or the SageMaker ModelTrainer SDK. With HyperPod, users can begin the process by connecting to the login/head node of the Slurm cluster.

Clustering 78

Clustering AWS ML ML 78

AWS Machine Learning Blog

JANUARY 17, 2024

Today, we’re excited to announce the availability of Llama 2 inference and fine-tuning support on AWS Trainium and AWS Inferentia instances in Amazon SageMaker JumpStart. In this post, we demonstrate how to deploy and fine-tune Llama 2 on Trainium and AWS Inferentia instances in SageMaker JumpStart.

AWS 133

AWS Python Machine Learning Machine Learning 133

AWS Machine Learning Blog

APRIL 7, 2025

Virginia) AWS Region. Prerequisites To try the Llama 4 models in SageMaker JumpStart, you need the following prerequisites: An AWS account that will contain all your AWS resources. An AWS Identity and Access Management (IAM) role to access SageMaker AI. Access to accelerated instances (GPUs) for hosting the LLMs.

AWS 120

AWS Machine Learning Machine Learning ML 120

AWS Machine Learning Blog

JUNE 23, 2023

Additionally, you can use AWS Lambda directly to expose your models and deploy your ML applications using your preferred open-source framework, which can prove to be more flexible and cost-effective. FastAPI is a modern, high-performance web framework for building APIs with Python. This will be used to deploy our solution.

AWS 102

AWS ML ML Python 102

Flipboard

JUNE 26, 2023

In this post, we look at how we can use AWS Glue and the AWS Lake Formation ML transform FindMatches to harmonize (deduplicate) customer data coming from different sources to get a complete customer profile to be able to provide better customer experience. Run the AWS Glue ML transform job.

AWS 123

AWS ML ML ETL 123

AWS Machine Learning Blog

MAY 4, 2023

AWS has been innovating with purpose-built chips to address the growing need for powerful, efficient, and cost-effective compute hardware. You can use ml.trn1 and ml.inf2 compatible AWS Deep Learning Containers (DLCs) for PyTorch, TensorFlow, Hugging Face, and large model inference (LMI) to easily get started. petaflops for BF16/FP16.

AWS 102

AWS Deep Learning Deep Learning ML 102

AWS Machine Learning Blog

MAY 1, 2024

Llama2 by Meta is an example of an LLM offered by AWS. To learn more about Llama 2 on AWS, refer to Llama 2 foundation models from Meta are now available in Amazon SageMaker JumpStart. Virginia) and US West (Oregon) AWS Regions, and most recently announced general availability in the US East (Ohio) Region.

AWS 128

AWS ML ML Clustering 128

AWS Machine Learning Blog

MARCH 8, 2023

This post shows a way to do this using Snowflake as the data source and by downloading the data directly from Snowflake into a SageMaker Training job instance. We create a custom training container that downloads data directly from the Snowflake table into the training instance rather than first downloading the data into an S3 bucket.

ML 135

ML ML AWS Python 135

AWS Machine Learning Blog

MARCH 18, 2025

With this launch, you can now deploy NVIDIAs optimized reranking and embedding models to build, experiment, and responsibly scale your generative AI ideas on AWS. As part of NVIDIA AI Enterprise available in AWS Marketplace , NIM is a set of user-friendly microservices designed to streamline and accelerate the deployment of generative AI.

AWS 111

AWS AI AI Computer Science 111

PyImageSearch

SEPTEMBER 30, 2024

Home Table of Contents Introduction to GitHub Actions for Python Projects Introduction What Is CICD? For Python projects, CI/CD pipelines ensure that your code is consistently integrated and delivered with high quality and reliability. Git is the most commonly used VCS for Python projects, enabling collaboration and version tracking.

Python 112

Python Deep Learning Deep Learning AWS 112

DrivenData Labs

NOVEMBER 14, 2023

VIIRS' Day/Night Band (DNB) sensor captures nightlight imagery that is useful for mapping populations. ECOSTRESS has been used in the midwestern United States to detects droughts early enough to recover and protect crops.

Python 162

Python AWS Azure Data Analysis 162

AWS Machine Learning Blog

MARCH 3, 2025

These recipes include a training stack validated by Amazon Web Services (AWS) , which removes the tedious work of experimenting with different model configurations, minimizing the time it takes for iterative evaluation and testing. Alternatively, you can also use AWS Systems Manager and run a command like the following to start the session.

Clustering 104

Clustering AWS ML ML 104

AWS Machine Learning Blog

JUNE 6, 2023

PyTorch is a machine learning (ML) framework that is widely used by AWS customers for a variety of applications, such as computer vision, natural language processing, content creation, and more. release, AWS customers can now do same things as they could with PyTorch 1.x 24xlarge with AWS PyTorch 2.0 on AWS PyTorch2.0

AWS 97

AWS ML ML Deep Learning 97

AWS Machine Learning Blog

AUGUST 30, 2023

This post demonstrates a strategy for fine-tuning publicly available LLMs for the task of radiology report summarization using AWS services. In the following sections, we demonstrate fine-tuning an LLM available on SageMaker JumpStart for summarization of a domain-specific task via the SageMaker Python SDK. We use an ml.t3.medium

AWS 137

AWS AI AI ML 137

AWS Machine Learning Blog

MARCH 15, 2024

In addition to Amazon Bedrock, you can use other AWS services like Amazon SageMaker JumpStart and Amazon Lex to create fully automated and easily adaptable generative AI order processing agents. In this post, we show you how to build a speech-capable order processing agent using Amazon Lex, Amazon Bedrock, and AWS Lambda.

AWS 141

AWS AI AI Python 141