Remove 2012 Remove Clustering Remove Support Vector Machines
article thumbnail

From Rulesets to Transformers: A Journey Through the Evolution of SOTA in NLP

Mlearning.ai

The earlier models that were SOTA for NLP mainly fell under the traditional machine learning algorithms. These included the Support vector machine (SVM) based models. Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM ” by Deepak Narayanan et al.

article thumbnail

Meet the winners of Phase 2 of the PREPARE Challenge

DrivenData Labs

Some participants combined a transformer neural network with a tree-based model or support vector machine (SVM). Cluster 0 was in English and included many people talking to an Alexa. Cluster 1 and 2 were both Spanish. Cluster 3 was Mandarin. changes between 2003 and 2012).