jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models

We introduce jiant, an open source toolkit for conducting multitask and transfer learning experiments on English NLU tasks. jiant enables modular and configuration-driven experimentation with state-of-the-art models and implements a broad set of tasks for probing, transfer learning, and multitask tr...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2020-05
Main Authors: Yada Pruksachatkun, Yeres, Phil, Liu, Haokun, Phang, Jason, Phu Mon Htut, Wang, Alex, Tenney, Ian, Bowman, Samuel R
Format: Article
Language:English
Subjects:
Experimentation
Learning
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We introduce jiant, an open source toolkit for conducting multitask and transfer learning experiments on English NLU tasks. jiant enables modular and configuration-driven experimentation with state-of-the-art models and implements a broad set of tasks for probing, transfer learning, and multitask training experiments. jiant implements over 50 NLU tasks, including all GLUE and SuperGLUE benchmark tasks. We demonstrate that jiant reproduces published performance on a variety of tasks and models, including BERT and RoBERTa. jiant is available at https://jiant.info.
ISSN:2331-8422