Annotation and Classification of Relevant Clauses in Terms-and-Conditions Contracts

In this paper, we propose a new annotation scheme to classify different types of clauses in Terms-and-Conditions contracts with the ultimate goal of supporting legal experts to quickly identify and assess problematic issues in this type of legal documents. To this end, we built a small corpus of Ter...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-02
Main Authors: Bizzaro, Pietro Giovanni, Elena Della Valentina, Napolitano, Maurizio, Mana, Nadia, Zancanaro, Massimo
Format: Article
Language:English
Subjects:
Annotations
Classification
Contracts
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we propose a new annotation scheme to classify different types of clauses in Terms-and-Conditions contracts with the ultimate goal of supporting legal experts to quickly identify and assess problematic issues in this type of legal documents. To this end, we built a small corpus of Terms-and-Conditions contracts and finalized an annotation scheme of 14 categories, eventually reaching an inter-annotator agreement of 0.92. Then, for 11 of them, we experimented with binary classification tasks using few-shot prompting with a multilingual T5 and two fine-tuned versions of two BERT-based LLMs for Italian. Our experiments showed the feasibility of automatic classification of our categories by reaching accuracies ranging from .79 to .95 on validation tasks.
ISSN:2331-8422