Loading…
An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments
Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwid...
Saved in:
Published in: | IEEE transactions on broadcasting 2021-12, Vol.67 (4), p.851-867 |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3 |
---|---|
cites | cdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3 |
container_end_page | 867 |
container_issue | 4 |
container_start_page | 851 |
container_title | IEEE transactions on broadcasting |
container_volume | 67 |
creator | Al-Jawad, Ahmed Comsa, Ioan-Sorin Shah, Purav Gemikonakli, Orhan Trestian, Ramona |
description | Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches. |
doi_str_mv | 10.1109/TBC.2021.3099728 |
format | article |
fullrecord | <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9509261</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9509261</ieee_id><sourcerecordid>2607876120</sourcerecordid><originalsourceid>FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</originalsourceid><addsrcrecordid>eNo9kMFPwjAUxhujiYjeTbw08Tx8XVm7HQFBSVBU8LyU7s0UodV2zHDyX3cLxNO7_L7vy_sRcs2gxxhkd8vhqBdDzHocskzG6QnpsCSRUSYYOyUdAJZGGWfinFyEsAYADhB3yO_A0qm1rlaVqZG-obGl8xq3aCs6Q-WtsR_RUAUs6MSrLf44_0kbhL7u1MZUe-pKukBfG430xbvaBOPaDJ3X6OnTblOZLRZGHTsW9890bGvjnW0nwiU5K9Um4NXxdsn7ZLwcPUaz-cN0NJhFmnNeRWIlgfexfUDJjBew6jMosGBSy0IkIHUpStVH6EOZSJ0qqTmkLNWNCyWY5l1ye-j98u57h6HK127nbTOZxwJkKgWLoaHgQGnvQvBY5l_ebJXf5wzyVnPeaM5bzflRcxO5OUQMIv7jWQJZLBj_A34Fec4</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2607876120</pqid></control><display><type>article</type><title>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Al-Jawad, Ahmed ; Comsa, Ioan-Sorin ; Shah, Purav ; Gemikonakli, Orhan ; Trestian, Ramona</creator><creatorcontrib>Al-Jawad, Ahmed ; Comsa, Ioan-Sorin ; Shah, Purav ; Gemikonakli, Orhan ; Trestian, Ramona</creatorcontrib><description>Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.</description><identifier>ISSN: 0018-9316</identifier><identifier>EISSN: 1557-9611</identifier><identifier>DOI: 10.1109/TBC.2021.3099728</identifier><identifier>CODEN: IETBAC</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Algorithms ; Bandwidth ; Context ; Heuristic algorithms ; Internet ; Learning ; Multimedia ; Network latency ; Provisioning ; QoE ; QoS ; Quality of experience ; Quality of service ; Quality of service architectures ; reinforcement learning ; Routing ; routing algorithms ; SDN ; Signal to noise ratio ; Software-defined networking ; Topology ; Traffic capacity ; Traffic flow ; Traffic management ; User experience</subject><ispartof>IEEE transactions on broadcasting, 2021-12, Vol.67 (4), p.851-867</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</citedby><cites>FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</cites><orcidid>0000-0002-0113-5690 ; 0000-0003-3315-3081</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9509261$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,54796</link.rule.ids></links><search><creatorcontrib>Al-Jawad, Ahmed</creatorcontrib><creatorcontrib>Comsa, Ioan-Sorin</creatorcontrib><creatorcontrib>Shah, Purav</creatorcontrib><creatorcontrib>Gemikonakli, Orhan</creatorcontrib><creatorcontrib>Trestian, Ramona</creatorcontrib><title>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</title><title>IEEE transactions on broadcasting</title><addtitle>TBC</addtitle><description>Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.</description><subject>Algorithms</subject><subject>Bandwidth</subject><subject>Context</subject><subject>Heuristic algorithms</subject><subject>Internet</subject><subject>Learning</subject><subject>Multimedia</subject><subject>Network latency</subject><subject>Provisioning</subject><subject>QoE</subject><subject>QoS</subject><subject>Quality of experience</subject><subject>Quality of service</subject><subject>Quality of service architectures</subject><subject>reinforcement learning</subject><subject>Routing</subject><subject>routing algorithms</subject><subject>SDN</subject><subject>Signal to noise ratio</subject><subject>Software-defined networking</subject><subject>Topology</subject><subject>Traffic capacity</subject><subject>Traffic flow</subject><subject>Traffic management</subject><subject>User experience</subject><issn>0018-9316</issn><issn>1557-9611</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNo9kMFPwjAUxhujiYjeTbw08Tx8XVm7HQFBSVBU8LyU7s0UodV2zHDyX3cLxNO7_L7vy_sRcs2gxxhkd8vhqBdDzHocskzG6QnpsCSRUSYYOyUdAJZGGWfinFyEsAYADhB3yO_A0qm1rlaVqZG-obGl8xq3aCs6Q-WtsR_RUAUs6MSrLf44_0kbhL7u1MZUe-pKukBfG430xbvaBOPaDJ3X6OnTblOZLRZGHTsW9890bGvjnW0nwiU5K9Um4NXxdsn7ZLwcPUaz-cN0NJhFmnNeRWIlgfexfUDJjBew6jMosGBSy0IkIHUpStVH6EOZSJ0qqTmkLNWNCyWY5l1ye-j98u57h6HK127nbTOZxwJkKgWLoaHgQGnvQvBY5l_ebJXf5wzyVnPeaM5bzflRcxO5OUQMIv7jWQJZLBj_A34Fec4</recordid><startdate>202112</startdate><enddate>202112</enddate><creator>Al-Jawad, Ahmed</creator><creator>Comsa, Ioan-Sorin</creator><creator>Shah, Purav</creator><creator>Gemikonakli, Orhan</creator><creator>Trestian, Ramona</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0002-0113-5690</orcidid><orcidid>https://orcid.org/0000-0003-3315-3081</orcidid></search><sort><creationdate>202112</creationdate><title>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</title><author>Al-Jawad, Ahmed ; Comsa, Ioan-Sorin ; Shah, Purav ; Gemikonakli, Orhan ; Trestian, Ramona</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Bandwidth</topic><topic>Context</topic><topic>Heuristic algorithms</topic><topic>Internet</topic><topic>Learning</topic><topic>Multimedia</topic><topic>Network latency</topic><topic>Provisioning</topic><topic>QoE</topic><topic>QoS</topic><topic>Quality of experience</topic><topic>Quality of service</topic><topic>Quality of service architectures</topic><topic>reinforcement learning</topic><topic>Routing</topic><topic>routing algorithms</topic><topic>SDN</topic><topic>Signal to noise ratio</topic><topic>Software-defined networking</topic><topic>Topology</topic><topic>Traffic capacity</topic><topic>Traffic flow</topic><topic>Traffic management</topic><topic>User experience</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Al-Jawad, Ahmed</creatorcontrib><creatorcontrib>Comsa, Ioan-Sorin</creatorcontrib><creatorcontrib>Shah, Purav</creatorcontrib><creatorcontrib>Gemikonakli, Orhan</creatorcontrib><creatorcontrib>Trestian, Ramona</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE</collection><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>IEEE transactions on broadcasting</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Al-Jawad, Ahmed</au><au>Comsa, Ioan-Sorin</au><au>Shah, Purav</au><au>Gemikonakli, Orhan</au><au>Trestian, Ramona</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments</atitle><jtitle>IEEE transactions on broadcasting</jtitle><stitle>TBC</stitle><date>2021-12</date><risdate>2021</risdate><volume>67</volume><issue>4</issue><spage>851</spage><epage>867</epage><pages>851-867</pages><issn>0018-9316</issn><eissn>1557-9611</eissn><coden>IETBAC</coden><abstract>Within the current global context, the coronavirus pandemic has led to an unprecedented surge in the Internet traffic, with most of the traffic represented by video. The improved wired and guided network infrastructure along with the emerging 5G networks enables the provisioning of increased bandwidth support while the virtualization introduced by the integration of Software Defined Networks (SDN) enables traffic management and remote orchestration of networking devices. However, the popularity and variety of multimedia-rich applications along with the increased number of users has led to an ever increasing pressure that these multimedia-rich content applications are placing on the underlying networks. Consequently, a simple increase in the system capacity will not be enough and an intelligent traffic management solution is required to enable the Quality of Service (QoS) provisioning. In this context, this paper proposes a Reinforcement Learning (RL)-based framework within a multimedia-based SDN environment, that decides on the most suitable routing algorithm to be applied on the QoS-based traffic flows to improve QoS provisioning. The proposed RL-based solution was implemented and evaluated using an experimental setup under a realistic SDN environment and compared against other state-of-the-art solutions from the literature in terms of throughput, packet loss, latency, peak signal-to-noise ratio (PSNR) and mean opinion score (MOS). The proposed RL-based framework finds the best trade-off between QoS vs. Quality of User Experience (QoE) when compared to other state-of-the-art approaches.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TBC.2021.3099728</doi><tpages>17</tpages><orcidid>https://orcid.org/0000-0002-0113-5690</orcidid><orcidid>https://orcid.org/0000-0003-3315-3081</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0018-9316 |
ispartof | IEEE transactions on broadcasting, 2021-12, Vol.67 (4), p.851-867 |
issn | 0018-9316 1557-9611 |
language | eng |
recordid | cdi_ieee_primary_9509261 |
source | IEEE Electronic Library (IEL) Journals |
subjects | Algorithms Bandwidth Context Heuristic algorithms Internet Learning Multimedia Network latency Provisioning QoE QoS Quality of experience Quality of service Quality of service architectures reinforcement learning Routing routing algorithms SDN Signal to noise ratio Software-defined networking Topology Traffic capacity Traffic flow Traffic management User experience |
title | An Innovative Reinforcement Learning-Based Framework for Quality of Service Provisioning Over Multimedia-Based SDN Environments |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T13%3A27%3A21IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20Innovative%20Reinforcement%20Learning-Based%20Framework%20for%20Quality%20of%20Service%20Provisioning%20Over%20Multimedia-Based%20SDN%20Environments&rft.jtitle=IEEE%20transactions%20on%20broadcasting&rft.au=Al-Jawad,%20Ahmed&rft.date=2021-12&rft.volume=67&rft.issue=4&rft.spage=851&rft.epage=867&rft.pages=851-867&rft.issn=0018-9316&rft.eissn=1557-9611&rft.coden=IETBAC&rft_id=info:doi/10.1109/TBC.2021.3099728&rft_dat=%3Cproquest_ieee_%3E2607876120%3C/proquest_ieee_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c333t-6b7034e9316a793d0b410ded17c7d6507cf6fa4e040f57c8a7c30818c997a61c3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2607876120&rft_id=info:pmid/&rft_ieee_id=9509261&rfr_iscdi=true |