Using POMDP-based state estimation to enhance agent system survivability

A survivable agent system depends on the incorporation of many recovery features. However, the optimal use of these recovery features requires the ability to assess the actual state of the agent system accurately at a given time. This paper describes an approach for the estimation of the state of an...

Full description

Saved in:
Bibliographic Details
Main Authors: Cassandra, A., Nodine, M., Bondale, S., Ford, S., Wells, D.
Format: Conference Proceeding
Language:English
Subjects:
Actuators
Bonding
Intelligent sensors
Logistics
Resilience
Robustness
Sensor phenomena and characterization
Sensor systems
State estimation
System testing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A survivable agent system depends on the incorporation of many recovery features. However, the optimal use of these recovery features requires the ability to assess the actual state of the agent system accurately at a given time. This paper describes an approach for the estimation of the state of an agent system using partially-observable Markov decision processes (POMDPs). POMDPs are dependent on a model of the agent system - components, environment, sensors, and the actuators that can correct problems. Based on this model, we define a state estimation for each component (asset) in the agent system. We model a survivable agent system as a POMDP that takes into account both environmental threats and observations from sensors. We describe the process of updating the state estimation as time passes, as sensor inputs are received, and as actuators affect changes. This state estimation process has been deployed within the Ultralog application and successfully tested using Ultralog's survivability tests on a full-scale (1000+) agent system.
DOI:10.1109/MASSUR.2005.1507043