article thumbnail

An Introduction to BigBird

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. Source: Canva|Arxiv Introduction In 2018 GoogleAI researchers developed Bidirectional Encoder Representations from Transformers (BERT) for various NLP tasks.

article thumbnail

Introduction to DistilBERT in Student Model

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. Source: Canva Introduction In 2018, GoogleAI researchers released the BERT model. It was a fantastic work that brought a revolution in the NLP domain. However, the BERT model did have some drawbacks i.e. it was bulky and hence a little slow.

professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

How GDPR Will Affect Data Science

Dataconomy

By now, any data professional worth his or her salt should know about the General Data Protection Regulation (GDPR). This EU law, set to be enforced in May 2018, has sent shockwaves (and a fair bit of fear) across many industries and professions. The post How GDPR Will Affect Data Science appeared first on Dataconomy.

article thumbnail

Different Types of Cloud-based Services

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. According to the IDC report, the world will spend $160 billion on cloud services and infrastructure in 2018. Introduction Cloud computing is one of the fastest-growing IT technologies today. By 2025, 83% of enterprise workloads will be in the cloud.

article thumbnail

Text Classification using BERT and TensorFlow

Analytics Vidhya

This article was published as a part of the Data Science Blogathon Introduction In 2018, a powerful Transformer-based machine learning model, namely, BERT was developed by Jacob Devlin and his colleagues from Google for NLP applications.

article thumbnail

Generative Pre-training (GPT) for Natural Language Understanding

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. Source: Canva Introduction In 2018 the researchers of OpenAI presented a framework for achieving strong natural language understanding (NLU) with a single task-agnostic model through generative pre-training and discriminative fine-tuning.

article thumbnail

ALBERT Model for Self-Supervised Learning

Analytics Vidhya

This article was published as a part of the Data Science Blogathon. Source: Canva Introduction In 2018, Google AI researchers came up with BERT, which revolutionized the NLP domain.