Some papers to get started with Natural Language Processing

I think the following papers are useful to understand the current state of Natural Language Processing. I recommend to read them in the order presented here.

Word Embeddings

• A Neural Probabilistic Language Model
• Efficient Estimation of Word Representations in Vector Space
• Distributed Representations of Words and Phrases and their Compositionality
• GloVe: Global Vectors for Word Representation

Sequence-to-Sequence Modelling

• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Sequence to Sequence learning with Neural Networks
• Neural Machine Translation by Jointly Learning to Align and Translate
• Convolutional Sequence to Sequence Learning
• Attention is All You Need

Pre-Trained Deep Language Models

• Improving Language Understanding by Generative Pre-Training
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
• Language Models are Unsupervised Multitask Learners
• Language Models are Few-Shot Learners