Decision Making Photonics: Solving Bandit Problems Using Photons

Decision making in dynamically changing uncertain environments is one of the most important elements in information and communications technology, in applications ranging from resource assignment in data centers to wireless communications and search functions. Here, we review our research on the eff...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of selected topics in quantum electronics 2020-01, Vol.26 (1), p.1-10
Main Authors: Naruse, Makoto, Chauvet, Nicolas, Uchida, Atsushi, Drezet, Aurelien, Bachelier, Guillaume, Huant, Serge, Hori, Hirokazu
Format: Article
Language:English
Subjects:
Acceleration
artificial intelligence
categorical system model
Data centers
Decision making
Decision theory
entangled photons
Exploration
laser chaos
Lasers
multi-armed bandit problem
Multi-armed bandit problems
Optical computing
Optical fiber networks
Optics
Photonics
Photons
Physics
Reinforcement learning
Reservoirs
single photon
Ultrafast lasers
Unknown environments
Wireless communications
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Decision making in dynamically changing uncertain environments is one of the most important elements in information and communications technology, in applications ranging from resource assignment in data centers to wireless communications and search functions. Here, we review our research on the efficient physical realization or acceleration of decision making using photonics. The problem of interest is the multi-armed bandit (MAB) problem, where the purpose is to maximize the total rewards in unknown environments that involve difficult tradeoffs in the so-called exploration-exploitation dilemma. We describe the principle of solving MAB problems by utilizing the wave-particle duality of single photons in which the probabilistic attributes of single light quanta are employed for exploration. The principle is transformed into ultrafast laser chaos, where the chaotically oscillating irregular time series provides fast and scalable decision making abilities. The problem becomes even more difficult when multiple players are involved, in the so-called competitive MAB (CMAB) problem, where the expected value is related to maximizing the social benefit and ensuring fairness among individuals. We demonstrate that entangled photons can resolve the CMAB problem. Theoretical studies on photonic decision making are also reviewed, showing that six entities in total interact with each other according to an octahedral structure.
ISSN:1077-260X
1558-4542
DOI:10.1109/JSTQE.2019.2929217