Anunnaki: A Modular Framework for Developing Trusted Artificial Intelligence

Trustworthy artificial intelligence (Trusted AI) is of utmost importance when learning-enabled components (LECs) are used in autonomous, safety-critical systems. When reliant on deep learning, these systems need to address the reliability, robustness, and interpretability of learning models. In addi...

Full description

Saved in:
Bibliographic Details
Published in:ACM transactions on autonomous and adaptive systems 2024-09, Vol.19 (3), p.1-34, Article 17
Main Authors: Langford, Michael Austin, Zilberman, Sol, Cheng, Betty
Format: Article
Language:English
Subjects:
Computer systems organization
Computing methodologies
Machine learning
Maintainability and maintenance
Model-driven software engineering
Neural networks
Planning under uncertainty
Software and its engineering
Software as a service orchestration system
Software reliability
Software safety
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Trustworthy artificial intelligence (Trusted AI) is of utmost importance when learning-enabled components (LECs) are used in autonomous, safety-critical systems. When reliant on deep learning, these systems need to address the reliability, robustness, and interpretability of learning models. In addition to developing strategies to address these concerns, appropriate software architectures are needed to coordinate LECs and ensure they deliver acceptable behavior even under uncertain conditions. This work describes Anunnaki, a model-driven framework comprising loosely-coupled modular services designed to monitor and manage LECs with respect to Trusted AI assurance concerns when faced with different sources of uncertainty. More specifically, the Anunnaki framework supports the composition of independent, modular services to assess and improve the resilience and robustness of AI systems. The design of Annunaki was guided by several key software engineering principles (e.g., modularity, composability, and reusability) in order to facilitate its use and maintenance to support different aggregate monitoring and assurance analysis tools for LESs and their respective data sets. We demonstrate Anunnaki on two autonomous platforms, a terrestrial rover, and an unmanned aerial vehicle. Our studies show how Anunnaki can be used to manage the operations of different autonomous learning-enabled systems with vision-based LECs while exposed to uncertain environmental conditions.
ISSN:1556-4665
1556-4703
DOI:10.1145/3649453