PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts

PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a dataset to a natural language input and target output. Using prompts to train and query language models is an emerging area in NLP that requires new tools that let use...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2022-03
Main Authors: Bach, Stephen H, Sanh, Victor, Zheng-Xin, Yong, Webson, Albert, Raffel, Colin, Nayak, Nihal V, Sharma, Abheesht, Kim, Taewoon, M Saiful Bari, Thibault Fevry, Alyafeai, Zaid, Dey, Manan, Santilli, Andrea, Sun, Zhiqing, Ben-David, Srulik, Xu, Canwen, Chhablani, Gunjan, Wang, Han, Fries, Jason Alan, Al-shaibani, Maged S, Sharma, Shanya, Thakker, Urmish, Almubarak, Khalid, Tang, Xiangru, Radev, Dragomir, Mike Tian-Jian Jiang, Rush, Alexander M
Format: Article
Language:English
Subjects:
Datasets
Natural language processing
Prompt engineering
Query languages
User requirements
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:PromptSource is a system for creating, sharing, and using natural language prompts. Prompts are functions that map an example from a dataset to a natural language input and target output. Using prompts to train and query language models is an emerging area in NLP that requires new tools that let users develop and refine these prompts collaboratively. PromptSource addresses the emergent challenges in this new setting with (1) a templating language for defining data-linked prompts, (2) an interface that lets users quickly iterate on prompt development by observing outputs of their prompts on many examples, and (3) a community-driven set of guidelines for contributing new prompts to a common pool. Over 2,000 prompts for roughly 170 datasets are already available in PromptSource. PromptSource is available at https://github.com/bigscience-workshop/promptsource.
ISSN:2331-8422