Loading…

Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance

Movement Primitives (MPs) have been widely used over the last years for learning robot motion tasks with direct Policy Search (PS) reinforcement learning. Among them, Probabilistic Movement Primitives (ProMPs) are a kind of MP based on a stochastic representation over sets of trajectories, which ben...

Full description

Saved in:
Bibliographic Details
Main Authors: Colome, Adria, Torras, Carme
Format: Conference Proceeding
Language:English
Subjects:
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page 3195
container_issue
container_start_page 3190
container_title
container_volume
creator Colome, Adria
Torras, Carme
description Movement Primitives (MPs) have been widely used over the last years for learning robot motion tasks with direct Policy Search (PS) reinforcement learning. Among them, Probabilistic Movement Primitives (ProMPs) are a kind of MP based on a stochastic representation over sets of trajectories, which benefits from the properties of probability operations. However, the generation of such ProMPs requires a set of demonstrations to capture motion variability. Additionally, using context variables to modify trajectories coded as MPs is a popular approach nowadays in order to adapt motion to environmental variables. This paper proposes a contextual representation of ProMPs that allows for an easy adaptation to changing situations through context variables, by reparametrizing motion with them. Moreover, we propose a way of initializing contextual trajectories without the need of real robot demonstrations, by setting an initial position, a final position, and a number of trajectory interest points, where the contextual variables are evaluated. The parametrizations obtained show to be accurate while relieving the user from the need of performing costly computations such as conditioning. Additionally, using this contextual representation, we propose a simple yet effective quadratic optimization-based obstacle avoidance method for ProMPs. Experiments in simulation and on a real robot show the promise of the approach.
doi_str_mv 10.1109/IROS.2017.8206151
format conference_proceeding
fullrecord <record><control><sourceid>ieee_CHZPO</sourceid><recordid>TN_cdi_ieee_primary_8206151</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>8206151</ieee_id><sourcerecordid>8206151</sourcerecordid><originalsourceid>FETCH-LOGICAL-c217t-92238e3a04c19d46de5fa80e08ca1961feb71fc7e546f87a439efed01b89de563</originalsourceid><addsrcrecordid>eNotUFtLwzAYjYLgmPsB4kt-gK350jaXR5k6B4OBl-eRpl9opG2kyebl19vhng7n8n0cDiHXwHIApu_WL9vXnDOQueJMQAVnZKGlgqpQggvFq3My4xPLmBLikixi_GCMAZNaaTEj_QP2YYhpNMmHIXMjIrVhSPid9qbzv9jQzzHUpvadj8lb2ocD9jikSfa9T_6A8Za6_ZhaHCkOrRnsdPPlU0tDHZOxHVJzCL45Glfkwpku4uKEc_L-9Pi2fM4229V6eb_JLAeZMs15obAwrLSgm1I0WDmjGDJlDWgBDmsJzkqsSuGUNGWh0WHDoFZ6yopiTm7-_3pE3B2bmvFndxqo-AMWxl07</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance</title><source>IEEE Xplore All Conference Series</source><creator>Colome, Adria ; Torras, Carme</creator><creatorcontrib>Colome, Adria ; Torras, Carme</creatorcontrib><description>Movement Primitives (MPs) have been widely used over the last years for learning robot motion tasks with direct Policy Search (PS) reinforcement learning. Among them, Probabilistic Movement Primitives (ProMPs) are a kind of MP based on a stochastic representation over sets of trajectories, which benefits from the properties of probability operations. However, the generation of such ProMPs requires a set of demonstrations to capture motion variability. Additionally, using context variables to modify trajectories coded as MPs is a popular approach nowadays in order to adapt motion to environmental variables. This paper proposes a contextual representation of ProMPs that allows for an easy adaptation to changing situations through context variables, by reparametrizing motion with them. Moreover, we propose a way of initializing contextual trajectories without the need of real robot demonstrations, by setting an initial position, a final position, and a number of trajectory interest points, where the contextual variables are evaluated. The parametrizations obtained show to be accurate while relieving the user from the need of performing costly computations such as conditioning. Additionally, using this contextual representation, we propose a simple yet effective quadratic optimization-based obstacle avoidance method for ProMPs. Experiments in simulation and on a real robot show the promise of the approach.</description><identifier>EISSN: 2153-0866</identifier><identifier>EISBN: 9781538626825</identifier><identifier>EISBN: 1538626829</identifier><identifier>DOI: 10.1109/IROS.2017.8206151</identifier><language>eng</language><publisher>IEEE</publisher><subject>Collision avoidance ; Covariance matrices ; Kernel ; Probabilistic logic ; Robots ; Trajectory</subject><ispartof>2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, p.3190-3195</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/8206151$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,27925,54555,54932</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/8206151$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Colome, Adria</creatorcontrib><creatorcontrib>Torras, Carme</creatorcontrib><title>Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance</title><title>2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)</title><addtitle>IROS</addtitle><description>Movement Primitives (MPs) have been widely used over the last years for learning robot motion tasks with direct Policy Search (PS) reinforcement learning. Among them, Probabilistic Movement Primitives (ProMPs) are a kind of MP based on a stochastic representation over sets of trajectories, which benefits from the properties of probability operations. However, the generation of such ProMPs requires a set of demonstrations to capture motion variability. Additionally, using context variables to modify trajectories coded as MPs is a popular approach nowadays in order to adapt motion to environmental variables. This paper proposes a contextual representation of ProMPs that allows for an easy adaptation to changing situations through context variables, by reparametrizing motion with them. Moreover, we propose a way of initializing contextual trajectories without the need of real robot demonstrations, by setting an initial position, a final position, and a number of trajectory interest points, where the contextual variables are evaluated. The parametrizations obtained show to be accurate while relieving the user from the need of performing costly computations such as conditioning. Additionally, using this contextual representation, we propose a simple yet effective quadratic optimization-based obstacle avoidance method for ProMPs. Experiments in simulation and on a real robot show the promise of the approach.</description><subject>Collision avoidance</subject><subject>Covariance matrices</subject><subject>Kernel</subject><subject>Probabilistic logic</subject><subject>Robots</subject><subject>Trajectory</subject><issn>2153-0866</issn><isbn>9781538626825</isbn><isbn>1538626829</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2017</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><recordid>eNotUFtLwzAYjYLgmPsB4kt-gK350jaXR5k6B4OBl-eRpl9opG2kyebl19vhng7n8n0cDiHXwHIApu_WL9vXnDOQueJMQAVnZKGlgqpQggvFq3My4xPLmBLikixi_GCMAZNaaTEj_QP2YYhpNMmHIXMjIrVhSPid9qbzv9jQzzHUpvadj8lb2ocD9jikSfa9T_6A8Za6_ZhaHCkOrRnsdPPlU0tDHZOxHVJzCL45Glfkwpku4uKEc_L-9Pi2fM4229V6eb_JLAeZMs15obAwrLSgm1I0WDmjGDJlDWgBDmsJzkqsSuGUNGWh0WHDoFZ6yopiTm7-_3pE3B2bmvFndxqo-AMWxl07</recordid><startdate>201709</startdate><enddate>201709</enddate><creator>Colome, Adria</creator><creator>Torras, Carme</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>201709</creationdate><title>Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance</title><author>Colome, Adria ; Torras, Carme</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c217t-92238e3a04c19d46de5fa80e08ca1961feb71fc7e546f87a439efed01b89de563</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Collision avoidance</topic><topic>Covariance matrices</topic><topic>Kernel</topic><topic>Probabilistic logic</topic><topic>Robots</topic><topic>Trajectory</topic><toplevel>online_resources</toplevel><creatorcontrib>Colome, Adria</creatorcontrib><creatorcontrib>Torras, Carme</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Colome, Adria</au><au>Torras, Carme</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance</atitle><btitle>2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)</btitle><stitle>IROS</stitle><date>2017-09</date><risdate>2017</risdate><spage>3190</spage><epage>3195</epage><pages>3190-3195</pages><eissn>2153-0866</eissn><eisbn>9781538626825</eisbn><eisbn>1538626829</eisbn><abstract>Movement Primitives (MPs) have been widely used over the last years for learning robot motion tasks with direct Policy Search (PS) reinforcement learning. Among them, Probabilistic Movement Primitives (ProMPs) are a kind of MP based on a stochastic representation over sets of trajectories, which benefits from the properties of probability operations. However, the generation of such ProMPs requires a set of demonstrations to capture motion variability. Additionally, using context variables to modify trajectories coded as MPs is a popular approach nowadays in order to adapt motion to environmental variables. This paper proposes a contextual representation of ProMPs that allows for an easy adaptation to changing situations through context variables, by reparametrizing motion with them. Moreover, we propose a way of initializing contextual trajectories without the need of real robot demonstrations, by setting an initial position, a final position, and a number of trajectory interest points, where the contextual variables are evaluated. The parametrizations obtained show to be accurate while relieving the user from the need of performing costly computations such as conditioning. Additionally, using this contextual representation, we propose a simple yet effective quadratic optimization-based obstacle avoidance method for ProMPs. Experiments in simulation and on a real robot show the promise of the approach.</abstract><pub>IEEE</pub><doi>10.1109/IROS.2017.8206151</doi><tpages>6</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier EISSN: 2153-0866
ispartof 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2017, p.3190-3195
issn 2153-0866
language eng
recordid cdi_ieee_primary_8206151
source IEEE Xplore All Conference Series
subjects Collision avoidance
Covariance matrices
Kernel
Probabilistic logic
Robots
Trajectory
title Demonstration-free contextualized probabilistic movement primitives, further enhanced with obstacle avoidance
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T01%3A23%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_CHZPO&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Demonstration-free%20contextualized%20probabilistic%20movement%20primitives,%20further%20enhanced%20with%20obstacle%20avoidance&rft.btitle=2017%20IEEE/RSJ%20International%20Conference%20on%20Intelligent%20Robots%20and%20Systems%20(IROS)&rft.au=Colome,%20Adria&rft.date=2017-09&rft.spage=3190&rft.epage=3195&rft.pages=3190-3195&rft.eissn=2153-0866&rft_id=info:doi/10.1109/IROS.2017.8206151&rft.eisbn=9781538626825&rft.eisbn_list=1538626829&rft_dat=%3Cieee_CHZPO%3E8206151%3C/ieee_CHZPO%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c217t-92238e3a04c19d46de5fa80e08ca1961feb71fc7e546f87a439efed01b89de563%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=8206151&rfr_iscdi=true