Loading…

End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning

Autonomous driving involves complex tasks such as data fusion, object and lane detection, behavior prediction, and path planning. As opposed to the modular approach which dedicates individual subsystems to tackle each of those tasks, the end-to-end approach treats the problem as a single learnable t...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-11
Main Authors: Kishky, Mahmoud M, Eraqi, Hesham M, Elsayed, Khaled F
Format: Article
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Kishky, Mahmoud M
Eraqi, Hesham M
Elsayed, Khaled F
description Autonomous driving involves complex tasks such as data fusion, object and lane detection, behavior prediction, and path planning. As opposed to the modular approach which dedicates individual subsystems to tackle each of those tasks, the end-to-end approach treats the problem as a single learnable task using deep neural networks, reducing system complexity and minimizing dependency on heuristics. Conditional imitation learning (CIL) trains the end-to-end model to mimic a human expert considering the navigational commands guiding the vehicle to reach its destination, CIL adopts specialist network branches dedicated to learn the driving task for each navigational command. Nevertheless, the CIL model lacked generalization when deployed to unseen environments. This work introduces the conditional imitation co-learning (CIC) approach to address this issue by enabling the model to learn the relationships between CIL specialist branches via a co-learning matrix generated by gated hyperbolic tangent units (GTUs). Additionally, we propose posing the steering regression problem as classification, we use a classification-regression hybrid loss to bridge the gap between regression and classification, we also propose using co-existence probability to consider the spatial tendency between the steering classes. Our model is demonstrated to improve autonomous driving success rate in unseen environment by 62% on average compared to the CIL method.
format article
fullrecord <record><control><sourceid>proquest</sourceid><recordid>TN_cdi_proquest_journals_3133055225</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3133055225</sourcerecordid><originalsourceid>FETCH-proquest_journals_31330552253</originalsourceid><addsrcrecordid>eNqNi0EKwjAUBYMgWLR3CLgOpEmjbqVUFNyI4rYEm2pKm6_5iec3ggdwNY_HzIRkQsqCbUohZiRH7DnnYrUWSsmMnGrXsgAsgZ6DMd66O-3A020M4GCEiPRqHvY2GKRvq2kFrrXBgtMDPYw26O9OLzsa7V2qF2Ta6QFN_uOcLHf1pdqzp4dXNBiaHqJPOTaykJIrJYSS_1kfaOo-4Q</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3133055225</pqid></control><display><type>article</type><title>End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning</title><source>Publicly Available Content Database</source><creator>Kishky, Mahmoud M ; Eraqi, Hesham M ; Elsayed, Khaled F</creator><creatorcontrib>Kishky, Mahmoud M ; Eraqi, Hesham M ; Elsayed, Khaled F</creatorcontrib><description>Autonomous driving involves complex tasks such as data fusion, object and lane detection, behavior prediction, and path planning. As opposed to the modular approach which dedicates individual subsystems to tackle each of those tasks, the end-to-end approach treats the problem as a single learnable task using deep neural networks, reducing system complexity and minimizing dependency on heuristics. Conditional imitation learning (CIL) trains the end-to-end model to mimic a human expert considering the navigational commands guiding the vehicle to reach its destination, CIL adopts specialist network branches dedicated to learn the driving task for each navigational command. Nevertheless, the CIL model lacked generalization when deployed to unseen environments. This work introduces the conditional imitation co-learning (CIC) approach to address this issue by enabling the model to learn the relationships between CIL specialist branches via a co-learning matrix generated by gated hyperbolic tangent units (GTUs). Additionally, we propose posing the steering regression problem as classification, we use a classification-regression hybrid loss to bridge the gap between regression and classification, we also propose using co-existence probability to consider the spatial tendency between the steering classes. Our model is demonstrated to improve autonomous driving success rate in unseen environment by 62% on average compared to the CIL method.</description><identifier>EISSN: 2331-8422</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Artificial neural networks ; Classification ; Data integration ; Machine learning ; Regression models ; Statistical analysis ; Steering ; Subsystems ; Task complexity</subject><ispartof>arXiv.org, 2024-11</ispartof><rights>2024. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/3133055225?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>780,784,25753,37012,44590</link.rule.ids></links><search><creatorcontrib>Kishky, Mahmoud M</creatorcontrib><creatorcontrib>Eraqi, Hesham M</creatorcontrib><creatorcontrib>Elsayed, Khaled F</creatorcontrib><title>End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning</title><title>arXiv.org</title><description>Autonomous driving involves complex tasks such as data fusion, object and lane detection, behavior prediction, and path planning. As opposed to the modular approach which dedicates individual subsystems to tackle each of those tasks, the end-to-end approach treats the problem as a single learnable task using deep neural networks, reducing system complexity and minimizing dependency on heuristics. Conditional imitation learning (CIL) trains the end-to-end model to mimic a human expert considering the navigational commands guiding the vehicle to reach its destination, CIL adopts specialist network branches dedicated to learn the driving task for each navigational command. Nevertheless, the CIL model lacked generalization when deployed to unseen environments. This work introduces the conditional imitation co-learning (CIC) approach to address this issue by enabling the model to learn the relationships between CIL specialist branches via a co-learning matrix generated by gated hyperbolic tangent units (GTUs). Additionally, we propose posing the steering regression problem as classification, we use a classification-regression hybrid loss to bridge the gap between regression and classification, we also propose using co-existence probability to consider the spatial tendency between the steering classes. Our model is demonstrated to improve autonomous driving success rate in unseen environment by 62% on average compared to the CIL method.</description><subject>Artificial neural networks</subject><subject>Classification</subject><subject>Data integration</subject><subject>Machine learning</subject><subject>Regression models</subject><subject>Statistical analysis</subject><subject>Steering</subject><subject>Subsystems</subject><subject>Task complexity</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqNi0EKwjAUBYMgWLR3CLgOpEmjbqVUFNyI4rYEm2pKm6_5iec3ggdwNY_HzIRkQsqCbUohZiRH7DnnYrUWSsmMnGrXsgAsgZ6DMd66O-3A020M4GCEiPRqHvY2GKRvq2kFrrXBgtMDPYw26O9OLzsa7V2qF2Ta6QFN_uOcLHf1pdqzp4dXNBiaHqJPOTaykJIrJYSS_1kfaOo-4Q</recordid><startdate>20241125</startdate><enddate>20241125</enddate><creator>Kishky, Mahmoud M</creator><creator>Eraqi, Hesham M</creator><creator>Elsayed, Khaled F</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope></search><sort><creationdate>20241125</creationdate><title>End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning</title><author>Kishky, Mahmoud M ; Eraqi, Hesham M ; Elsayed, Khaled F</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-proquest_journals_31330552253</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Artificial neural networks</topic><topic>Classification</topic><topic>Data integration</topic><topic>Machine learning</topic><topic>Regression models</topic><topic>Statistical analysis</topic><topic>Steering</topic><topic>Subsystems</topic><topic>Task complexity</topic><toplevel>online_resources</toplevel><creatorcontrib>Kishky, Mahmoud M</creatorcontrib><creatorcontrib>Eraqi, Hesham M</creatorcontrib><creatorcontrib>Elsayed, Khaled F</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kishky, Mahmoud M</au><au>Eraqi, Hesham M</au><au>Elsayed, Khaled F</au><format>book</format><genre>document</genre><ristype>GEN</ristype><atitle>End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning</atitle><jtitle>arXiv.org</jtitle><date>2024-11-25</date><risdate>2024</risdate><eissn>2331-8422</eissn><abstract>Autonomous driving involves complex tasks such as data fusion, object and lane detection, behavior prediction, and path planning. As opposed to the modular approach which dedicates individual subsystems to tackle each of those tasks, the end-to-end approach treats the problem as a single learnable task using deep neural networks, reducing system complexity and minimizing dependency on heuristics. Conditional imitation learning (CIL) trains the end-to-end model to mimic a human expert considering the navigational commands guiding the vehicle to reach its destination, CIL adopts specialist network branches dedicated to learn the driving task for each navigational command. Nevertheless, the CIL model lacked generalization when deployed to unseen environments. This work introduces the conditional imitation co-learning (CIC) approach to address this issue by enabling the model to learn the relationships between CIL specialist branches via a co-learning matrix generated by gated hyperbolic tangent units (GTUs). Additionally, we propose posing the steering regression problem as classification, we use a classification-regression hybrid loss to bridge the gap between regression and classification, we also propose using co-existence probability to consider the spatial tendency between the steering classes. Our model is demonstrated to improve autonomous driving success rate in unseen environment by 62% on average compared to the CIL method.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2024-11
issn 2331-8422
language eng
recordid cdi_proquest_journals_3133055225
source Publicly Available Content Database
subjects Artificial neural networks
Classification
Data integration
Machine learning
Regression models
Statistical analysis
Steering
Subsystems
Task complexity
title End-to-End Steering for Autonomous Vehicles via Conditional Imitation Co-Learning
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T13%3A42%3A52IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=document&rft.atitle=End-to-End%20Steering%20for%20Autonomous%20Vehicles%20via%20Conditional%20Imitation%20Co-Learning&rft.jtitle=arXiv.org&rft.au=Kishky,%20Mahmoud%20M&rft.date=2024-11-25&rft.eissn=2331-8422&rft_id=info:doi/&rft_dat=%3Cproquest%3E3133055225%3C/proquest%3E%3Cgrp_id%3Ecdi_FETCH-proquest_journals_31330552253%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=3133055225&rft_id=info:pmid/&rfr_iscdi=true