AWS Machine Learning Blog

NOVEMBER 13, 2024

Recognizing this need, we have developed a Chrome extension that harnesses the power of AWS AI and generative AI services, including Amazon Bedrock , an AWS managed service to build and scale generative AI applications with foundation models (FMs). The user signs in by entering a user name and a password.

AWS 136

AWS AI AI Natural Language Processing 136

Flipboard

MARCH 4, 2025

To achieve these goals, the AWS Well-Architected Framework provides comprehensive guidance for building and improving cloud architectures. This allows teams to focus more on implementing improvements and optimizing AWS infrastructure. This systematic approach leads to more reliable and standardized evaluations.

AWS 164

AWS AI AI Database 164

AWS Machine Learning Blog

NOVEMBER 7, 2024

It also uses a number of other AWS services such as Amazon API Gateway , AWS Lambda , and Amazon SageMaker. You can use AWS services such as Application Load Balancer to implement this approach. Some applications may need to access data with personal identifiable information (PII) while others may rely on noncritical data.

AWS 122

AWS AI AI Machine Learning 122

Flipboard

JANUARY 14, 2025

In this post, we show how to extend Amazon Bedrock Agents to hybrid and edge services such as AWS Outposts and AWS Local Zones to build distributed Retrieval Augmented Generation (RAG) applications with on-premises data for improved model outcomes.

AWS 152

AWS Database AI AI 152

AWS Machine Learning Blog

NOVEMBER 26, 2024

AWS Trainium and AWS Inferentia based instances, combined with Amazon Elastic Kubernetes Service (Amazon EKS), provide a performant and low cost framework to run LLMs efficiently in a containerized environment. For more information on how to view and increase your quotas, refer to Amazon EC2 service quotas.

AWS 108

AWS Clustering ML ML 108

AWS Machine Learning Blog

NOVEMBER 15, 2024

This wealth of content provides an opportunity to streamline access to information in a compliant and responsible way. Principal wanted to use existing internal FAQs, documentation, and unstructured data and build an intelligent chatbot that could provide quick access to the right information for different roles.

AWS 123

AWS AI AI Machine Learning 123

Flipboard

JUNE 5, 2025

Amazon SageMaker AI provides a fully managed service for deploying these machine learning (ML) models with multiple inference options, allowing organizations to optimize for cost, latency, and throughput. AWS has always provided customers with choice. That includes model choice, hardware choice, and tooling choice.

AWS 111

AWS AI AI ML 111

Flipboard

FEBRUARY 11, 2025

Amazon Q Business , a new generative AI-powered assistant, can answer questions, provide summaries, generate content, and securely complete tasks based on data and information in an enterprises systems. Then we introduce the solution deployment using three AWS CloudFormation templates.

AWS 155

AWS ML ML Machine Learning 155

AWS Machine Learning Blog

MAY 16, 2025

In this post, we share how Amazon Web Services (AWS) is helping Scuderia Ferrari HP develop more accurate pit stop analysis techniques using machine learning (ML). Since implementing the solution with AWS, track operations engineers can synchronize the data up to 80% faster than manual methods.

AWS 84

AWS Machine Learning Machine Learning ML 84

AWS Machine Learning Blog

DECEMBER 24, 2024

To simplify infrastructure setup and accelerate distributed training, AWS introduced Amazon SageMaker HyperPod in late 2023. In this blog post, we showcase how you can perform efficient supervised fine tuning for a Meta Llama 3 model using PEFT on AWS Trainium with SageMaker HyperPod. architectures/5.sagemaker-hyperpod/LifecycleScripts/base-config/

AWS 112

AWS Clustering Deep Learning Deep Learning 112

Flipboard

MAY 28, 2025

Rufus is an AI-powered shopping assistant designed to help customers make informed purchasing decisions. This post focuses on how the QP model used draft centric speculative decoding (SD)also called parallel decodingwith AWS AI chips to meet the demands of Prime Day. Rufus extended the base LLM with multiple decoding heads.

AWS 115

AWS AI AI Machine Learning 115

Flipboard

NOVEMBER 19, 2024

Amazon Bedrock offers a serverless experience so you can get started quickly, privately customize FMs with your own data, and integrate and deploy them into your applications using AWS tools without having to manage infrastructure. This can lead to inefficiencies, delays, and errors, diminishing customer satisfaction.

AWS 153

AWS AI AI ML 153

AWS Machine Learning Blog

NOVEMBER 26, 2024

Amazon SageMaker Studio is the first integrated development environment (IDE) purposefully designed to accelerate end-to-end machine learning (ML) development. These automations can greatly decrease overhead related to ML project setup, facilitate technical consistency, and save costs related to running idle instances.

AWS 98

AWS Data Scientist ML ML 98

AWS Machine Learning Blog

NOVEMBER 25, 2024

8B and 70B inference support on AWS Trainium and AWS Inferentia instances in Amazon SageMaker JumpStart. Trainium and Inferentia, enabled by the AWS Neuron software development kit (SDK), offer high performance and lower the cost of deploying Meta Llama 3.1 An AWS Identity and Access Management (IAM) role to access SageMaker.

AWS 104

AWS Python ML ML 104

AWS Machine Learning Blog

NOVEMBER 13, 2024

A reverse image search engine enables users to upload an image to find related information instead of using text-based queries. The AWS Command Line Interface (AWS CLI) installed on your machine to upload the dataset to Amazon S3. For more information on managing credentials securely, see the AWS Boto3 documentation.

AWS 124

AWS Database K-nearest Neighbors AI 124

AWS Machine Learning Blog

DECEMBER 4, 2024

Scaling machine learning (ML) workflows from initial prototypes to large-scale production deployment can be daunting task, but the integration of Amazon SageMaker Studio and Amazon SageMaker HyperPod offers a streamlined solution to this challenge. Make sure you have the latest version of the AWS Command Line Interface (AWS CLI).

ML 104

ML ML Clustering AWS 104

AWS Machine Learning Blog

OCTOBER 22, 2024

Amazon SageMaker is a cloud-based machine learning (ML) platform within the AWS ecosystem that offers developers a seamless and convenient way to build, train, and deploy ML models. For more information about this architecture, see New – Code Editor, based on Code-OSS VS Code Open Source now available in Amazon SageMaker Studio.

AWS 122

AWS ML ML Machine Learning 122

Flipboard

MAY 30, 2025

Scaling and load balancing The gateway can handle load balancing across different servers, model instances, or AWS Regions so that applications remain responsive. The AWS Solutions Library offers solution guidance to set up a multi-provider generative AI gateway. Leave us a comment and we will be glad to collaborate.

AWS 140

AWS AI AI Database 140

AWS Machine Learning Blog

OCTOBER 16, 2024

The company developed an automated solution called Call Quality (CQ) using AI services from Amazon Web Services (AWS). In this post, we demonstrate how the CQ solution used Amazon Transcribe and other AWS services to improve critical KPIs with AI-powered contact center call auditing and analytics.

AWS 94

AWS AI AI Machine Learning 94

AWS Machine Learning Blog

JANUARY 7, 2025

To address this need, AWS generative AI best practices framework was launched within AWS Audit Manager , enabling auditing and monitoring of generative AI applications. The agent then interprets the users request and determines if actions need to be invoked or information needs to be retrieved from a knowledge base.

AWS 119

AWS AI AI Database 119

Flipboard

MAY 28, 2025

Machine learning (ML) has emerged as a powerful tool to help nonprofits expedite manual processes, quickly unlock insights from data, and accelerate mission outcomesfrom personalizing marketing materials for donors to predicting member churn and donation patterns. It supports multiple predictive problem types.

Machine Learning 122

Machine Learning Machine Learning ML ML 122

AWS Machine Learning Blog

OCTOBER 31, 2024

Previously, setting up a custom labeling job required specifying two AWS Lambda functions: a pre-annotation function, which is run on each dataset object before it’s sent to workers, and a post-annotation function, which is run on the annotations of each dataset object and consolidates multiple worker annotations if needed.

AWS 125

AWS Natural Language Processing ML ML 125

Flipboard

DECEMBER 3, 2024

Syngenta and AWS collaborated to develop Cropwise AI , an innovative solution powered by Amazon Bedrock Agents , to accelerate their sales reps’ ability to place Syngenta seed products with growers across North America. This post was written with Zach Marston and Serg Masis from Syngenta.

AWS 150

AWS AI AI Machine Learning 150

AWS Machine Learning Blog

FEBRUARY 26, 2025

ByteDance is a technology company that operates a range of content platforms to inform, educate, entertain, and inspire people across languages, cultures, and geographies. By using sophisticated ML algorithms, the platform efficiently scans billions of videos each day.

AWS 97

AWS ML ML Clustering 97

AWS Machine Learning Blog

NOVEMBER 13, 2024

You can now register machine learning (ML) models in Amazon SageMaker Model Registry with Amazon SageMaker Model Cards , making it straightforward to manage governance information for specific model versions directly in SageMaker Model Registry in just a few clicks.

ML 121

ML ML AWS Data Preparation 121

AWS Machine Learning Blog

DECEMBER 26, 2024

The potential for such large business value is galvanizing tens of thousands of enterprises to build their generative AI applications in AWS. This post addresses these cost considerations so you can optimize your generative AI costs in AWS. The costs, limits, and models can change over time.

AWS 143

AWS Database AI AI 143

AWS Machine Learning Blog

NOVEMBER 26, 2024

Using vLLM on AWS Trainium and Inferentia makes it possible to host LLMs for high performance inference and scalability. Deploy vLLM on AWS Trainium and Inferentia EC2 instances In these sections, you will be guided through using vLLM on an AWS Inferentia EC2 instance to deploy Meta’s newest Llama 3.2 You will use inf2.xlarge

AWS 110

AWS AI AI Artificial Intelligence 110

AWS Machine Learning Blog

APRIL 3, 2025

Theyre constantly seeking ways to use their vast amounts of information to gain competitive advantages. This post explores how OMRON Europe is using Amazon Web Services (AWS) to build its advanced ODAP and its progress toward harnessing the power of generative AI. Data is one of the most critical assets of many organizations.

AWS 90

AWS Data Governance Data Silos SQL 90

AWS Machine Learning Blog

MARCH 20, 2025

As AWS environments grow in complexity, troubleshooting issues with resources can become a daunting task. Fortunately, AWS provides a powerful tool called AWS Support Automation Workflows , which is a collection of curated AWS Systems Manager self-service automation runbooks. The agent uses Anthropics Claude 3.5

AWS 104

AWS Clustering AI AI 104

AWS Machine Learning Blog

MAY 16, 2025

This post is co-authored by Manuel Lopez Roldan, SiMa.ai, and Jason Westra, AWS Senior Solutions Architect. Are you looking to deploy machine learning (ML) models at the edge? Edgematic with SageMaker JupyterLab to deploy an ML model, YOLOv7 , to the edge. If you dont have an AWS account, you can create one.

AWS 83

AWS AI AI ML 83

Flipboard

APRIL 23, 2025

Retrieval Augmented Generation (RAG) applications have become increasingly popular due to their ability to enhance generative AI tasks with contextually relevant information. To assist in this effort, AWS provides a range of generative AI security strategies that you can use to create appropriate threat models.

AWS 151

AWS ML ML AI 151

AWS Machine Learning Blog

MAY 15, 2025

The banking industry has long struggled with the inefficiencies associated with repetitive processes such as information extraction, document review, and auditing. To address these inefficiencies, the implementation of advanced information extraction systems is crucial.

AWS 91

AWS ML ML Machine Learning 91

AWS Machine Learning Blog

MARCH 10, 2025

Investment professionals face the mounting challenge of processing vast amounts of data to make timely, informed decisions. This challenge is particularly acute in credit markets, where the complexity of information and the need for quick, accurate insights directly impacts investment outcomes.

AWS 115

AWS Database AI AI 115

Flipboard

JANUARY 24, 2025

Use the AWS generative AI scoping framework to understand the specific mix of the shared responsibility for the security controls applicable to your application. The following figure of the AWS Generative AI Security Scoping Matrix summarizes the types of models for each scope.

AWS 160

AWS AI AI Data Warehouse 160

AWS Machine Learning Blog

DECEMBER 12, 2024

By enabling scripts to filter content and remove personally identifiable information (PII), this integration streamlines the deployment process, encapsulating the necessary steps within the model configuration for better management and deployment of models with specific inference requirements.

ML 111

ML ML Python AWS 111

Flipboard

MAY 13, 2025

In this post, we demonstrate a solution using Amazon Elastic Kubernetes Service (EKS) with Amazon Bedrock to build scalable and containerized RAG solutions for your generative AI applications on AWS while bringing your unstructured user file data to Amazon Bedrock in a straightforward, fast, and secure way. Sonnet on Amazon Bedrock.

AWS 150

AWS AI AI Clustering 150

AWS Machine Learning Blog

FEBRUARY 6, 2025

We show how to then prepare the fine-tuned model to run on AWS Inferentia2 powered Amazon EC2 Inf2 instances , unlocking superior price performance for your inference workloads. After the model is fine-tuned, you can compile and host the fine-tuned SDXL on Inf2 instances using the AWS Neuron SDK. An Amazon Web Services (AWS) account.

AWS 95

AWS Machine Learning Machine Learning Deep Learning 95