2009, AWS and Big Data Analytics - Data Science Current

Strictly Necessary: Used for the proper function of the website
Performance/Analytics: Used for monitoring website traffic and interactions

Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium

AWS Machine Learning Blog

OCTOBER 5, 2023

In this post, we walk through how to fine-tune Llama 2 on AWS Trainium , a purpose-built accelerator for LLM training, to reduce training times and costs. We review the fine-tuning scripts provided by the AWS Neuron SDK (using NeMo Megatron-LM), the various configurations we used, and the throughput results we saw.

AWS

AWS Machine Learning Machine Learning Deep Learning

Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium

Stay Connected