Information, uncertainty and the manipulability of artificial intelligence autonomous vehicles systems

• Published in: International journal of human-computer studies 2019-10, Vol.130, p.40-46
• Main Authors: Osório, António, Pinto, Alberto
• Format: Article
• Language: English
• Subjects: Artificial intelligence; Autonomous vehicles; Malicious behavior; Manipulation; Uncertainty
• ISSN: 1071-5819; 1095-9300
• DOI: 10.1016/j.ijhcs.2019.05.003

•AV utilitarian protocols implies some predictability.•If AV decision process is perfectly known then is manipulable.•Sufficiently high levels of uncertainty are necessary.•Uncertainty decreases the risk of successful manipulation.•(but) Uncertainty decrease the quality of the decision process, efficiency and welfare. In an avoidable harmful situation, autonomous vehicles systems are expected to choose the course of action that causes the less damage to everybody. However, this behavioral protocol implies some predictability. In this context, we show that if the autonomous vehicle decision process is perfectly known then malicious, opportunistic, terrorist, criminal and non-civic individuals may have incentives to manipulate it. Consequently, some levels of uncertainty are necessary for the system to be manipulation proof. Uncertainty removes the misbehavior incentives because it increases the risk and likelihood of unsuccessful manipulation. However, uncertainty may also decrease the quality of the decision process with negative impact in terms of efficiency and welfare for the society. We also discuss other possible solutions to this problem.