AWS Machine Learning Blog

OCTOBER 5, 2023

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS 128

AWS Machine Learning Machine Learning Deep Learning 128

AWS Machine Learning Blog

DECEMBER 12, 2023

In this post, we’ll summarize training procedure of GPT NeoX on AWS Trainium , a purpose-built machine learning (ML) accelerator optimized for deep learning training. M tokens/$) trained such models with AWS Trainium without losing any model quality. We’ll outline how we cost-effectively (3.2 billion in Pythia. 2048 256 10.4

AWS 127

AWS Machine Learning Machine Learning Deep Learning 127

Data Science Dojo

JUNE 6, 2023

In 2009, Uber came along and revolutionized the entire taxi business. The term “digital transformation” is broad enough to encompass everything from “IT modernization” (such as cloud computing) to “digital optimization” (such as “big data”) to “new digital business models.”

Big Data 195

Big Data Big Data Cloud Computing Machine Learning 195

Flipboard

JUNE 18, 2025

Bernard is a best-selling author and advisor on AI, big data, and digital transformation. Miller Allie is the former Global Head of Machine Learning Business Development for Startups and Venture Capital at AWS, Allie is a prominent AI strategist and advisor. His focus is very much on AI education at all levels. #2.

AI 101

AI AI Machine Learning Machine Learning 101

AWS Machine Learning Blog

JANUARY 30, 2023

Distributed training is a technique that allows for the parallel processing of large amounts of data across multiple machines or devices. By splitting the data and training multiple models in parallel, distributed training can significantly reduce training time and improve the performance of models on big data.

Algorithm 104

Algorithm Clustering Machine Learning Machine Learning 104