Loading…

An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments

Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwid...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on broadcasting 2021-12, Vol.67 (4), p.851-867
Main Authors: Al-Jawad, Ahmed, Comsa, Ioan-Sorin, Shah, Purav, Gemikonakli, Orhan, Trestian, Ramona
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3
cites cdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3
container_end_page 867
container_issue 4
container_start_page 851
container_title IEEE transactions on broadcasting
container_volume 67
creator Al-Jawad, Ahmed
Comsa, Ioan-Sorin
Shah, Purav
Gemikonakli, Orhan
Trestian, Ramona
description Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.
doi_str_mv 10.1109/TBC.2021.3099728
format article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9509261</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9509261</ieee_id><sourcerecordid>2607876120</sourcerecordid><originalsourceid>FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</originalsourceid><addsrcrecordid>eNo9kMFPwjAUxhujiYjeTbw08Tx8XVm7HQFBSVBU8LyU7s0UodV2zHDyX3cLxNO7_L7vy_sRcs2gxxhkd8vhqBdDzHocskzG6QnpsCSRUSYYOyUdAJZGGWfinFyEsAYADhB3yO_A0qm1rlaVqZG-obGl8xq3aCs6Q-WtsR_RUAUs6MSrLf44_0kbhL7u1MZUe-pKukBfG430xbvaBOPaDJ3X6OnTblOZLRZGHTsW9890bGvjnW0nwiU5K9Um4NXxdsn7ZLwcPUaz-cN0NJhFmnNeRWIlgfexfUDJjBew6jMosGBSy0IkIHUpStVH6EOZSJ0qqTmkLNWNCyWY5l1ye-j98u57h6HK127nbTOZxwJkKgWLoaHgQGnvQvBY5l_ebJXf5wzyVnPeaM5bzflRcxO5OUQMIv7jWQJZLBj_A34Fec4</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2607876120</pqid></control><display><type>article</type><title>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Al-Jawad, Ahmed ; Comsa, Ioan-Sorin ; Shah, Purav ; Gemikonakli, Orhan ; Trestian, Ramona</creator><creatorcontrib>Al-Jawad, Ahmed ; Comsa, Ioan-Sorin ; Shah, Purav ; Gemikonakli, Orhan ; Trestian, Ramona</creatorcontrib><description>Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.</description><identifier>ISSN: 0018-9316</identifier><identifier>EISSN: 1557-9611</identifier><identifier>DOI: 10.1109/TBC.2021.3099728</identifier><identifier>CODEN: IETBAC</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Algorithms ; Bandwidth ; Context ; Heuristic algorithms ; Internet ; Learning ; Multimedia ; Network latency ; Provisioning ; QoE ; QoS ; Quality of experience ; Quality of service ; Quality of service architectures ; reinforcement learning ; Routing ; routing algorithms ; SDN ; Signal to noise ratio ; Software-defined networking ; Topology ; Traffic capacity ; Traffic flow ; Traffic management ; User experience</subject><ispartof>IEEE transactions on broadcasting, 2021-12, Vol.67 (4), p.851-867</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</citedby><cites>FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</cites><orcidid>0000-0002-0113-5690 ; 0000-0003-3315-3081</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9509261$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids></links><search><creatorcontrib>Al-Jawad, Ahmed</creatorcontrib><creatorcontrib>Comsa, Ioan-Sorin</creatorcontrib><creatorcontrib>Shah, Purav</creatorcontrib><creatorcontrib>Gemikonakli, Orhan</creatorcontrib><creatorcontrib>Trestian, Ramona</creatorcontrib><title>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</title><title>IEEE transactions on broadcasting</title><addtitle>TBC</addtitle><description>Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.</description><subject>Algorithms</subject><subject>Bandwidth</subject><subject>Context</subject><subject>Heuristic algorithms</subject><subject>Internet</subject><subject>Learning</subject><subject>Multimedia</subject><subject>Network latency</subject><subject>Provisioning</subject><subject>QoE</subject><subject>QoS</subject><subject>Quality of experience</subject><subject>Quality of service</subject><subject>Quality of service architectures</subject><subject>reinforcement learning</subject><subject>Routing</subject><subject>routing algorithms</subject><subject>SDN</subject><subject>Signal to noise ratio</subject><subject>Software-defined networking</subject><subject>Topology</subject><subject>Traffic capacity</subject><subject>Traffic flow</subject><subject>Traffic management</subject><subject>User experience</subject><issn>0018-9316</issn><issn>1557-9611</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNo9kMFPwjAUxhujiYjeTbw08Tx8XVm7HQFBSVBU8LyU7s0UodV2zHDyX3cLxNO7_L7vy_sRcs2gxxhkd8vhqBdDzHocskzG6QnpsCSRUSYYOyUdAJZGGWfinFyEsAYADhB3yO_A0qm1rlaVqZG-obGl8xq3aCs6Q-WtsR_RUAUs6MSrLf44_0kbhL7u1MZUe-pKukBfG430xbvaBOPaDJ3X6OnTblOZLRZGHTsW9890bGvjnW0nwiU5K9Um4NXxdsn7ZLwcPUaz-cN0NJhFmnNeRWIlgfexfUDJjBew6jMosGBSy0IkIHUpStVH6EOZSJ0qqTmkLNWNCyWY5l1ye-j98u57h6HK127nbTOZxwJkKgWLoaHgQGnvQvBY5l_ebJXf5wzyVnPeaM5bzflRcxO5OUQMIv7jWQJZLBj_A34Fec4</recordid><startdate>202112</startdate><enddate>202112</enddate><creator>Al-Jawad, Ahmed</creator><creator>Comsa, Ioan-Sorin</creator><creator>Shah, Purav</creator><creator>Gemikonakli, Orhan</creator><creator>Trestian, Ramona</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-0113-5690</orcidid><orcidid>https://orcid.org/0000-0003-3315-3081</orcidid></search><sort><creationdate>202112</creationdate><title>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</title><author>Al-Jawad, Ahmed ; Comsa, Ioan-Sorin ; Shah, Purav ; Gemikonakli, Orhan ; Trestian, Ramona</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Bandwidth</topic><topic>Context</topic><topic>Heuristic algorithms</topic><topic>Internet</topic><topic>Learning</topic><topic>Multimedia</topic><topic>Network latency</topic><topic>Provisioning</topic><topic>QoE</topic><topic>QoS</topic><topic>Quality of experience</topic><topic>Quality of service</topic><topic>Quality of service architectures</topic><topic>reinforcement learning</topic><topic>Routing</topic><topic>routing algorithms</topic><topic>SDN</topic><topic>Signal to noise ratio</topic><topic>Software-defined networking</topic><topic>Topology</topic><topic>Traffic capacity</topic><topic>Traffic flow</topic><topic>Traffic management</topic><topic>User experience</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Al-Jawad, Ahmed</creatorcontrib><creatorcontrib>Comsa, Ioan-Sorin</creatorcontrib><creatorcontrib>Shah, Purav</creatorcontrib><creatorcontrib>Gemikonakli, Orhan</creatorcontrib><creatorcontrib>Trestian, Ramona</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE</collection><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on broadcasting</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Al-Jawad, Ahmed</au><au>Comsa, Ioan-Sorin</au><au>Shah, Purav</au><au>Gemikonakli, Orhan</au><au>Trestian, Ramona</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</atitle><jtitle>IEEE transactions on broadcasting</jtitle><stitle>TBC</stitle><date>2021-12</date><risdate>2021</risdate><volume>67</volume><issue>4</issue><spage>851</spage><epage>867</epage><pages>851-867</pages><issn>0018-9316</issn><eissn>1557-9611</eissn><coden>IETBAC</coden><abstract>Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TBC.2021.3099728</doi><tpages>17</tpages><orcidid>https://orcid.org/0000-0002-0113-5690</orcidid><orcidid>https://orcid.org/0000-0003-3315-3081</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0018-9316
ispartof IEEE transactions on broadcasting, 2021-12, Vol.67 (4), p.851-867
issn 0018-9316
1557-9611
language eng
recordid cdi_ieee_primary_9509261
source IEEE Electronic Library (IEL) Journals
subjects Algorithms
Bandwidth
Context
Heuristic algorithms
Internet
Learning
Multimedia
Network latency
Provisioning
QoE
QoS
Quality of experience
Quality of service
Quality of service architectures
reinforcement learning
Routing
routing algorithms
SDN
Signal to noise ratio
Software-defined networking
Topology
Traffic capacity
Traffic flow
Traffic management
User experience
title An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T13%3A27%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20Innovative%20Reinforcement%20Learning-Based%20Framework%20for%20Quality%20of%20Service%20Provisioning%20Over%20Multimedia-Based%20SDN%20Environments&rft.jtitle=IEEE%20transactions%20on%20broadcasting&rft.au=Al-Jawad,%20Ahmed&rft.date=2021-12&rft.volume=67&rft.issue=4&rft.spage=851&rft.epage=867&rft.pages=851-867&rft.issn=0018-9316&rft.eissn=1557-9611&rft.coden=IETBAC&rft_id=info:doi/10.1109/TBC.2021.3099728&rft_dat=%3Cproquest_ieee_%3E2607876120%3C/proquest_ieee_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2607876120&rft_id=info:pmid/&rft_ieee_id=9509261&rfr_iscdi=true