Multi-armed bandit formulation for autonomous mobile acoustic relay adaptive positioning

We apply the stationary multi-armed bandit (MAB) formalism to the problem of maximizing underwater acoustic data transmission through adaptive positioning of a mobile relay. Shallow-water environments, in particular, show complex and variable performance across physical space. This is a classic expl...

Full description

Saved in:
Bibliographic Details
Main Authors: Mei Yi Cheung, Leighton, Joshua, Hover, Franz S.
Format: Conference Proceeding
Language:English
Subjects:
Acoustics
Data communication
Indexes
Mobile communication
Modems
Relays
Vehicles
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page 4170
container_issue
container_start_page 4165
container_title
container_volume
creator Mei Yi Cheung
Leighton, Joshua
Hover, Franz S.
description We apply the stationary multi-armed bandit (MAB) formalism to the problem of maximizing underwater acoustic data transmission through adaptive positioning of a mobile relay. Shallow-water environments, in particular, show complex and variable performance across physical space. This is a classic exploration vs. exploitation scenario, since choosing to visit new sites to learn their properties may be disadvantageous for cumulative data transmission if a better-performing site is already known with high confidence. Normal Gittins indices define a rule by which an optimal relay position can be chosen at each decision epoch, without assuming prior information and while pursuing the overall goal of maximizing total data transmission. We present results from shallow-water field experiments conducted with autonomous surface vehicles and acoustic modems transmitting data through a one-way, two-hop network in the Charles River Basin, Boston.
doi_str_mv 10.1109/ICRA.2013.6631165
format conference_proceeding
fullrecord <record><control><sourceid>ieee_CHZPO</sourceid><recordid>TN_cdi_ieee_primary_6631165</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6631165</ieee_id><sourcerecordid>6631165</sourcerecordid><originalsourceid>FETCH-LOGICAL-i241t-355beaf6e87e19fbb8b4265e4e04a0ff452144550483ce2eb0f27ae593f736193</originalsourceid><addsrcrecordid>eNo1kNtKAzEYhOMJrHUfQLzJC2zNOZvLUqwWKoIo9K78af9IZHez7GaFvr0W69XM8DFzMYTccTbjnLmH1eJtPhOMy5kxknOjz0jhbMWVsVIbJfU5mQhtbckqu7kgN_-A20sy4UyzUlnhrkkxDF-MMWEqqZyZkM3LWOdYQt_gnnpo9zHTkPpmrCHH1B49hTGnNjVpHGiTfKyRwu435LijPdZwoLCHLsdvpF0a4rEW289bchWgHrA46ZR8LB_fF8_l-vVptZivyygUz6XU2iMEg5VF7oL3lVfCaFTIFLAQlBZcKa2ZquQOBXoWhAXUTgYrDXdySu7_diMibrs-NtAftqeT5A_66Vgk</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Multi-armed bandit formulation for autonomous mobile acoustic relay adaptive positioning</title><source>IEEE Xplore All Conference Series</source><creator>Mei Yi Cheung ; Leighton, Joshua ; Hover, Franz S.</creator><creatorcontrib>Mei Yi Cheung ; Leighton, Joshua ; Hover, Franz S.</creatorcontrib><description>We apply the stationary multi-armed bandit (MAB) formalism to the problem of maximizing underwater acoustic data transmission through adaptive positioning of a mobile relay. Shallow-water environments, in particular, show complex and variable performance across physical space. This is a classic exploration vs. exploitation scenario, since choosing to visit new sites to learn their properties may be disadvantageous for cumulative data transmission if a better-performing site is already known with high confidence. Normal Gittins indices define a rule by which an optimal relay position can be chosen at each decision epoch, without assuming prior information and while pursuing the overall goal of maximizing total data transmission. We present results from shallow-water field experiments conducted with autonomous surface vehicles and acoustic modems transmitting data through a one-way, two-hop network in the Charles River Basin, Boston.</description><identifier>ISSN: 1050-4729</identifier><identifier>ISBN: 1467356417</identifier><identifier>ISBN: 9781467356411</identifier><identifier>EISSN: 2577-087X</identifier><identifier>EISBN: 9781467356435</identifier><identifier>EISBN: 1467356433</identifier><identifier>DOI: 10.1109/ICRA.2013.6631165</identifier><language>eng</language><publisher>IEEE</publisher><subject>Acoustics ; Data communication ; Indexes ; Mobile communication ; Modems ; Relays ; Vehicles</subject><ispartof>2013 IEEE International Conference on Robotics and Automation, 2013, p.4165-4170</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6631165$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,778,782,787,788,2054,27912,54542,54907,54919</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/6631165$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Mei Yi Cheung</creatorcontrib><creatorcontrib>Leighton, Joshua</creatorcontrib><creatorcontrib>Hover, Franz S.</creatorcontrib><title>Multi-armed bandit formulation for autonomous mobile acoustic relay adaptive positioning</title><title>2013 IEEE International Conference on Robotics and Automation</title><addtitle>ICRA</addtitle><description>We apply the stationary multi-armed bandit (MAB) formalism to the problem of maximizing underwater acoustic data transmission through adaptive positioning of a mobile relay. Shallow-water environments, in particular, show complex and variable performance across physical space. This is a classic exploration vs. exploitation scenario, since choosing to visit new sites to learn their properties may be disadvantageous for cumulative data transmission if a better-performing site is already known with high confidence. Normal Gittins indices define a rule by which an optimal relay position can be chosen at each decision epoch, without assuming prior information and while pursuing the overall goal of maximizing total data transmission. We present results from shallow-water field experiments conducted with autonomous surface vehicles and acoustic modems transmitting data through a one-way, two-hop network in the Charles River Basin, Boston.</description><subject>Acoustics</subject><subject>Data communication</subject><subject>Indexes</subject><subject>Mobile communication</subject><subject>Modems</subject><subject>Relays</subject><subject>Vehicles</subject><issn>1050-4729</issn><issn>2577-087X</issn><isbn>1467356417</isbn><isbn>9781467356411</isbn><isbn>9781467356435</isbn><isbn>1467356433</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2013</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><recordid>eNo1kNtKAzEYhOMJrHUfQLzJC2zNOZvLUqwWKoIo9K78af9IZHez7GaFvr0W69XM8DFzMYTccTbjnLmH1eJtPhOMy5kxknOjz0jhbMWVsVIbJfU5mQhtbckqu7kgN_-A20sy4UyzUlnhrkkxDF-MMWEqqZyZkM3LWOdYQt_gnnpo9zHTkPpmrCHH1B49hTGnNjVpHGiTfKyRwu435LijPdZwoLCHLsdvpF0a4rEW289bchWgHrA46ZR8LB_fF8_l-vVptZivyygUz6XU2iMEg5VF7oL3lVfCaFTIFLAQlBZcKa2ZquQOBXoWhAXUTgYrDXdySu7_diMibrs-NtAftqeT5A_66Vgk</recordid><startdate>201305</startdate><enddate>201305</enddate><creator>Mei Yi Cheung</creator><creator>Leighton, Joshua</creator><creator>Hover, Franz S.</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>201305</creationdate><title>Multi-armed bandit formulation for autonomous mobile acoustic relay adaptive positioning</title><author>Mei Yi Cheung ; Leighton, Joshua ; Hover, Franz S.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i241t-355beaf6e87e19fbb8b4265e4e04a0ff452144550483ce2eb0f27ae593f736193</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2013</creationdate><topic>Acoustics</topic><topic>Data communication</topic><topic>Indexes</topic><topic>Mobile communication</topic><topic>Modems</topic><topic>Relays</topic><topic>Vehicles</topic><toplevel>online_resources</toplevel><creatorcontrib>Mei Yi Cheung</creatorcontrib><creatorcontrib>Leighton, Joshua</creatorcontrib><creatorcontrib>Hover, Franz S.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE/IET Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Mei Yi Cheung</au><au>Leighton, Joshua</au><au>Hover, Franz S.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Multi-armed bandit formulation for autonomous mobile acoustic relay adaptive positioning</atitle><btitle>2013 IEEE International Conference on Robotics and Automation</btitle><stitle>ICRA</stitle><date>2013-05</date><risdate>2013</risdate><spage>4165</spage><epage>4170</epage><pages>4165-4170</pages><issn>1050-4729</issn><eissn>2577-087X</eissn><isbn>1467356417</isbn><isbn>9781467356411</isbn><eisbn>9781467356435</eisbn><eisbn>1467356433</eisbn><abstract>We apply the stationary multi-armed bandit (MAB) formalism to the problem of maximizing underwater acoustic data transmission through adaptive positioning of a mobile relay. Shallow-water environments, in particular, show complex and variable performance across physical space. This is a classic exploration vs. exploitation scenario, since choosing to visit new sites to learn their properties may be disadvantageous for cumulative data transmission if a better-performing site is already known with high confidence. Normal Gittins indices define a rule by which an optimal relay position can be chosen at each decision epoch, without assuming prior information and while pursuing the overall goal of maximizing total data transmission. We present results from shallow-water field experiments conducted with autonomous surface vehicles and acoustic modems transmitting data through a one-way, two-hop network in the Charles River Basin, Boston.</abstract><pub>IEEE</pub><doi>10.1109/ICRA.2013.6631165</doi><tpages>6</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1050-4729
ispartof 2013 IEEE International Conference on Robotics and Automation, 2013, p.4165-4170
issn 1050-4729
2577-087X
language eng
recordid cdi_ieee_primary_6631165
source IEEE Xplore All Conference Series
subjects Acoustics
Data communication
Indexes
Mobile communication
Modems
Relays
Vehicles
title Multi-armed bandit formulation for autonomous mobile acoustic relay adaptive positioning
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-15T21%3A29%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_CHZPO&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Multi-armed%20bandit%20formulation%20for%20autonomous%20mobile%20acoustic%20relay%20adaptive%20positioning&rft.btitle=2013%20IEEE%20International%20Conference%20on%20Robotics%20and%20Automation&rft.au=Mei%20Yi%20Cheung&rft.date=2013-05&rft.spage=4165&rft.epage=4170&rft.pages=4165-4170&rft.issn=1050-4729&rft.eissn=2577-087X&rft.isbn=1467356417&rft.isbn_list=9781467356411&rft_id=info:doi/10.1109/ICRA.2013.6631165&rft.eisbn=9781467356435&rft.eisbn_list=1467356433&rft_dat=%3Cieee_CHZPO%3E6631165%3C/ieee_CHZPO%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-i241t-355beaf6e87e19fbb8b4265e4e04a0ff452144550483ce2eb0f27ae593f736193%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=6631165&rfr_iscdi=true