MiRA—Mixed Reality Agents

• Published in: International journal of human-computer studies 2011-04, Vol.69 (4), p.251-268
• Main Authors: Holz, Thomas, Campbell, Abraham G., O’Hare, Gregory M.P., Stafford, John W., Martin, Alan, Dragone, Mauro
• Format: Article
• Language: English
• Subjects: Applied sciences; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Exact sciences and technology; Information systems. Data bases; Interaction metaphors; Memory organisation. Data processing; Mixed Reality; Mixed Reality Agents; Software; Survey
• ISSN: 1071-5819; 1095-9300
• DOI: 10.1016/j.ijhcs.2010.10.001

In recent years, an increasing number of Mixed Reality (MR) applications have been developed using agent technology — both for the underlying software and as an interface metaphor. However, no unifying field or theory currently exists that can act as a common frame of reference for these varied works. As a result, much duplication of research is evidenced in the literature. This paper seeks to fill this important gap by outlining “for the first time” a formal field of research that has hitherto gone unacknowledged, namely the field of Mixed Reality Agents (MiRAs), which are defined as agents embodied in a Mixed Reality environment. Based on this definition, a taxonomy is offered that classifies MiRAs along three axes: agency, based on the weak and strong notions outlined by Wooldridge and Jennings (1995); corporeal presence, which describes the degree of virtual or physical representation (body) of a MiRA; and interactive capacity, which characterises its ability to sense and act on the virtual and physical environment. Furthermore, this paper offers the first comprehensive survey of the state-of-the-art of MiRA research and places each project within the proposed taxonomy. Finally, common trends and future directions for MiRA research are discussed. By defining Mixed Reality Agents as a formal field, establishing a common taxonomy, and retrospectively placing existing MiRA projects within it, future researchers can effectively position their research within this landscape, thereby avoiding duplication and fostering reuse and interoperability. ►The paper introduces the concept of Mixed Reality Agent (MiRA). ►A classification of MiRAs is provided via the MiRA Cube Taxonomy. ►The taxonomy spans the axes of agency, corporeal presence, and interactive capacity. ►Five distinct areas are identified where existing projects cluster in the MiRA Cube.