Safety cases for frontier AI

As frontier artificial intelligence (AI) systems become more capable, it becomes more important that developers can explain why their systems are sufficiently safe. One way to do so is via safety cases: reports that make a structured argument, supported by evidence, that a system is safe enough in a...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-10
Main Authors: Marie Davidsen Buhl, Sett, Gaurav, Koessler, Leonie, Schuett, Jonas, Anderljung, Markus
Format: Article
Language:English
Subjects:
Air safety
Artificial intelligence
Government regulations
Industrial safety
Nuclear safety
Safety critical
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:As frontier artificial intelligence (AI) systems become more capable, it becomes more important that developers can explain why their systems are sufficiently safe. One way to do so is via safety cases: reports that make a structured argument, supported by evidence, that a system is safe enough in a given operational context. Safety cases are already common in other safety-critical industries such as aviation and nuclear power. In this paper, we explain why they may also be a useful tool in frontier AI governance, both in industry self-regulation and government regulation. We then discuss the practicalities of safety cases, outlining how to produce a frontier AI safety case and discussing what still needs to happen before safety cases can substantially inform decisions.
ISSN:2331-8422