Multi-Task Deep Neural Networks for Natural Language Understanding

In MT-BERT we reproduce a neural language understanding model which implements a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple NLU tasks.