Efficient continual pre-training LLMs for financial domains
AWS Machine Learning Blog
MARCH 28, 2024
Large language models (LLMs) are generally trained on large publicly available datasets that are domain agnostic. These datasets encompass a broad range of topics and domains. Continual pre-training vs. fine-tuning Most available LLMs are general purpose and lack domain-specific abilities. On average, the FinPythia 6.9B
91 
Let's personalize your content