Nature language process

Aspect Specific Opinion Expression Extraction using Attention based LSTM-CRF Network. arxiv
BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning. arxiv
BioBERT: pre-trained biomedical language representation model for biomedical text mining. arxiv
Cross-lingual Language Model Pretraining. arxiv
Does BERT Make Any Sense? Interpretable Word Sense Disambiguation with Contextualized Embeddings. arxiv code
GILT: Generating Images from Long Text. arxiv
Open Research Knowledge Graph: Towards Machine Actionability in Scholarly Communication. arxiv
SumQE: a BERT-based Summary Quality Estimation Model. arxiv code
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context. arxiv code

Embedding

A Multi-Resolution Word Embedding for Document Retrieval from Large Unstructured Knowledge Bases. arxiv
Word Embeddings for Sentiment Analysis: A Comprehensive Empirical Survey. arxiv
Fast Transformer Decoding: One Write-Head is All You Need. arxiv

Modeling Latent Sentence Structure in Neural Machine Translation. arxiv
Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation. arxiv

DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehension. arxiv
Review Conversational Reading Comprehension. arxiv

Delta-training: Simple Semi-Supervised Text Classification using Pretrained Word Embeddings. arxiv
EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks. arxiv code
Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach. pdf code