DOCMASTER: A Unified Platform for Annotation, Training, & Inference in Document Question-Answering

• Published in: arXiv.org 2024-03
• Main Authors: Nguyen, Alex, Wang, Zilong, Shang, Jingbo, Mekala, Dheeraj
• Format: Article
• Language: English
• Subjects: Annotations; Inference; Layouts; Natural language processing; Portable document format; Privacy; Questions
• ISSN: 2331-8422

The application of natural language processing models to PDF documents is pivotal for various business applications yet the challenge of training models for this purpose persists in businesses due to specific hurdles. These include the complexity of working with PDF formats that necessitate parsing text and layout information for curating training data and the lack of privacy-preserving annotation tools. This paper introduces DOCMASTER, a unified platform designed for annotating PDF documents, model training, and inference, tailored to document question-answering. The annotation interface enables users to input questions and highlight text spans within the PDF file as answers, saving layout information and text spans accordingly. Furthermore, DOCMASTER supports both state-of-the-art layout-aware and text models for comprehensive training purposes. Importantly, as annotations, training, and inference occur on-device, it also safeguards privacy. The platform has been instrumental in driving several research prototypes concerning document analysis such as the AI assistant utilized by University of California San Diego's (UCSD) International Services and Engagement Office (ISEO) for processing a substantial volume of PDF documents.