Compliance checking on first-order knowledge with conflicting and compensatory norms: a comparison among currently available technologies

• Published in: Artificial intelligence and law 2024-06, Vol.32 (2), p.505-555
• Main Authors: Robaldo, Livio, Batsakis, Sotiris, Calegari, Roberta, Calimeri, Francesco, Fujita, Megumi, Governatori, Guido, Morelli, Maria Concetta, Pacenza, Francesco, Pisano, Giuseppe, Satoh, Ken, Tachmazidis, Ilias, Zangari, Jessica
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Compliance; Computer Science; Information Storage and Retrieval; Intellectual Property; IT Law; Legal Aspects of Computing; Liquor; Media Law; Original Research; Philosophy of Law; Source code; Synthetic data
• ISSN: 0924-8463; 1572-8382
• DOI: 10.1007/s10506-023-09360-z

This paper analyses and compares some of the automated reasoners that have been used in recent research for compliance checking. Although the list of the considered reasoners is not exhaustive, we believe that our analysis is representative enough to take stock of the current state of the art in the topic. We are interested here in formalizations at the first-order level. Past literature on normative reasoning mostly focuses on the propositional level. However, the propositional level is of little usefulness for concrete LegalTech applications, in which compliance checking must be enforced on (large) sets of individuals. Furthermore, we are interested in technologies that are freely available and that can be further investigated and compared by the scientific community. In other words, this paper does not consider technologies only employed in industry and/or whose source code is non-accessible. This paper formalizes a selected use case in the considered reasoners and compares the implementations, also in terms of simulations with respect to shared synthetic datasets. The comparison will highlight that lot of further research still needs to be done to integrate the benefits featured by the different reasoners into a single standardized first-order framework, suitable for LegalTech applications. All source codes are freely available at https://github.com/liviorobaldo/compliancecheckers , together with instructions to locally reproduce the simulations.