Loading…

Optimized Tile Quality Selection in Multi-User 360° Video Streaming

360° videos and virtual reality (VR) are among the defining applications for a new era of immersive multimedia technologies. However, streaming high-quality 360° videos constitutes a challenge for service providers and network operators, especially in multi-user scenarios. The massive data rates and...

Full description

Saved in:
Bibliographic Details
Published in:IEEE open journal of the Communications Society 2024, Vol.5, p.7301-7316
Main Authors: Mahmoud, Moatasim, Rizou, Stamatia, Panayides, Andreas S., Kantartzis, Nikolaos V., Karagiannidis, George K., Lazaridis, Pavlos I., Zaharis, Zaharias D.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c1318-c1ef1dc431d59a0e381dd9bf5414dfc481cbaae29ea9897e0e58cd73afa29c63
container_end_page 7316
container_issue
container_start_page 7301
container_title IEEE open journal of the Communications Society
container_volume 5
creator Mahmoud, Moatasim
Rizou, Stamatia
Panayides, Andreas S.
Kantartzis, Nikolaos V.
Karagiannidis, George K.
Lazaridis, Pavlos I.
Zaharis, Zaharias D.
description 360° videos and virtual reality (VR) are among the defining applications for a new era of immersive multimedia technologies. However, streaming high-quality 360° videos constitutes a challenge for service providers and network operators, especially in multi-user scenarios. The massive data rates and the unique features of omnidirectional videos necessitate the development of novel streaming techniques. In this paper, we propose an optimized multi-user tiled 360° video streaming framework. Specifically, we formulate the problem of tile quality selection in multi-user bandwidth-constrained communications and propose an algorithm that assigns the quality levels of transmitted tiles. The proposed framework is designed to maximize the perceived quality within the users' viewports by considering 360° video quality assessment (360° VQA) metrics and tile viewing percentages. To simulate our solution in practical settings, we employ a long short-term memory (LSTM) model to perform viewport prediction and make the assessment based on real-life viewing data. Simulation results of our proposed framework show significant improvement in the delivered viewports' quality and robustness against increasing the number of users.
doi_str_mv 10.1109/OJCOMS.2024.3498334
format article
fullrecord <record><control><sourceid>doaj_ieee_</sourceid><recordid>TN_cdi_ieee_primary_10753298</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10753298</ieee_id><doaj_id>oai_doaj_org_article_36baa2a4d48d408a9de171e16e6ca14b</doaj_id><sourcerecordid>oai_doaj_org_article_36baa2a4d48d408a9de171e16e6ca14b</sourcerecordid><originalsourceid>FETCH-LOGICAL-c1318-c1ef1dc431d59a0e381dd9bf5414dfc481cbaae29ea9897e0e58cd73afa29c63</originalsourceid><addsrcrecordid>eNpNkE1OwzAQRi0EEhX0BLDwBVo8tpPYS1T-ilpFqAWxs1x7UrlKm8pJF-VUnIGTkZIKdTMz-jTfWzxCboANAZi-y19H-XQ25IzLoZBaCSHPSI-nUg6AJ5_nJ_cl6df1ijHGEwAQskce8m0T1uELPZ2HEunbzpah2dMZluiaUG1o2NDprmzC4L3GSEXKfr7pR_BY0VkT0a7DZnlNLgpb1tg_7isyf3qcj14Gk_x5PLqfDBwIUO3EAryTAnyiLUOhwHu9KBIJ0hdOKnALa5FrtFrpDBkmyvlM2MJy7VJxRcYd1ld2ZbYxrG3cm8oG8xdUcWlsbIIr0Yi0JXErvVReMmW1R8gAIcXUWZCLliU6lotVXUcs_nnAzEGr6bSag1Zz1Nq2brtWQMSTRpYI3n78AtV2dP8</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Optimized Tile Quality Selection in Multi-User 360° Video Streaming</title><source>IEEE Xplore Open Access Journals</source><creator>Mahmoud, Moatasim ; Rizou, Stamatia ; Panayides, Andreas S. ; Kantartzis, Nikolaos V. ; Karagiannidis, George K. ; Lazaridis, Pavlos I. ; Zaharis, Zaharias D.</creator><creatorcontrib>Mahmoud, Moatasim ; Rizou, Stamatia ; Panayides, Andreas S. ; Kantartzis, Nikolaos V. ; Karagiannidis, George K. ; Lazaridis, Pavlos I. ; Zaharis, Zaharias D.</creatorcontrib><description>360° videos and virtual reality (VR) are among the defining applications for a new era of immersive multimedia technologies. However, streaming high-quality 360° videos constitutes a challenge for service providers and network operators, especially in multi-user scenarios. The massive data rates and the unique features of omnidirectional videos necessitate the development of novel streaming techniques. In this paper, we propose an optimized multi-user tiled 360° video streaming framework. Specifically, we formulate the problem of tile quality selection in multi-user bandwidth-constrained communications and propose an algorithm that assigns the quality levels of transmitted tiles. The proposed framework is designed to maximize the perceived quality within the users' viewports by considering 360° video quality assessment (360° VQA) metrics and tile viewing percentages. To simulate our solution in practical settings, we employ a long short-term memory (LSTM) model to perform viewport prediction and make the assessment based on real-life viewing data. Simulation results of our proposed framework show significant improvement in the delivered viewports' quality and robustness against increasing the number of users.</description><identifier>ISSN: 2644-125X</identifier><identifier>EISSN: 2644-125X</identifier><identifier>DOI: 10.1109/OJCOMS.2024.3498334</identifier><identifier>CODEN: IOJCAZ</identifier><language>eng</language><publisher>IEEE</publisher><subject>360° videos ; Bandwidth ; Bit rate ; Measurement ; Multicast communication ; Optimization ; Quality of experience ; Resists ; Streaming media ; video quality assessment (VQA) ; Video streaming ; Virtual reality ; virtual reality (VR)</subject><ispartof>IEEE open journal of the Communications Society, 2024, Vol.5, p.7301-7316</ispartof><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c1318-c1ef1dc431d59a0e381dd9bf5414dfc481cbaae29ea9897e0e58cd73afa29c63</cites><orcidid>0000-0003-0959-7838 ; 0000-0001-5091-2567 ; 0009-0002-7552-5533 ; 0000-0002-4548-282X ; 0000-0001-9829-7946 ; 0000-0001-8810-0345</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10753298$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Mahmoud, Moatasim</creatorcontrib><creatorcontrib>Rizou, Stamatia</creatorcontrib><creatorcontrib>Panayides, Andreas S.</creatorcontrib><creatorcontrib>Kantartzis, Nikolaos V.</creatorcontrib><creatorcontrib>Karagiannidis, George K.</creatorcontrib><creatorcontrib>Lazaridis, Pavlos I.</creatorcontrib><creatorcontrib>Zaharis, Zaharias D.</creatorcontrib><title>Optimized Tile Quality Selection in Multi-User 360° Video Streaming</title><title>IEEE open journal of the Communications Society</title><addtitle>OJCOMS</addtitle><description>360° videos and virtual reality (VR) are among the defining applications for a new era of immersive multimedia technologies. However, streaming high-quality 360° videos constitutes a challenge for service providers and network operators, especially in multi-user scenarios. The massive data rates and the unique features of omnidirectional videos necessitate the development of novel streaming techniques. In this paper, we propose an optimized multi-user tiled 360° video streaming framework. Specifically, we formulate the problem of tile quality selection in multi-user bandwidth-constrained communications and propose an algorithm that assigns the quality levels of transmitted tiles. The proposed framework is designed to maximize the perceived quality within the users' viewports by considering 360° video quality assessment (360° VQA) metrics and tile viewing percentages. To simulate our solution in practical settings, we employ a long short-term memory (LSTM) model to perform viewport prediction and make the assessment based on real-life viewing data. Simulation results of our proposed framework show significant improvement in the delivered viewports' quality and robustness against increasing the number of users.</description><subject>360° videos</subject><subject>Bandwidth</subject><subject>Bit rate</subject><subject>Measurement</subject><subject>Multicast communication</subject><subject>Optimization</subject><subject>Quality of experience</subject><subject>Resists</subject><subject>Streaming media</subject><subject>video quality assessment (VQA)</subject><subject>Video streaming</subject><subject>Virtual reality</subject><subject>virtual reality (VR)</subject><issn>2644-125X</issn><issn>2644-125X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>DOA</sourceid><recordid>eNpNkE1OwzAQRi0EEhX0BLDwBVo8tpPYS1T-ilpFqAWxs1x7UrlKm8pJF-VUnIGTkZIKdTMz-jTfWzxCboANAZi-y19H-XQ25IzLoZBaCSHPSI-nUg6AJ5_nJ_cl6df1ijHGEwAQskce8m0T1uELPZ2HEunbzpah2dMZluiaUG1o2NDprmzC4L3GSEXKfr7pR_BY0VkT0a7DZnlNLgpb1tg_7isyf3qcj14Gk_x5PLqfDBwIUO3EAryTAnyiLUOhwHu9KBIJ0hdOKnALa5FrtFrpDBkmyvlM2MJy7VJxRcYd1ld2ZbYxrG3cm8oG8xdUcWlsbIIr0Yi0JXErvVReMmW1R8gAIcXUWZCLliU6lotVXUcs_nnAzEGr6bSag1Zz1Nq2brtWQMSTRpYI3n78AtV2dP8</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Mahmoud, Moatasim</creator><creator>Rizou, Stamatia</creator><creator>Panayides, Andreas S.</creator><creator>Kantartzis, Nikolaos V.</creator><creator>Karagiannidis, George K.</creator><creator>Lazaridis, Pavlos I.</creator><creator>Zaharis, Zaharias D.</creator><general>IEEE</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-0959-7838</orcidid><orcidid>https://orcid.org/0000-0001-5091-2567</orcidid><orcidid>https://orcid.org/0009-0002-7552-5533</orcidid><orcidid>https://orcid.org/0000-0002-4548-282X</orcidid><orcidid>https://orcid.org/0000-0001-9829-7946</orcidid><orcidid>https://orcid.org/0000-0001-8810-0345</orcidid></search><sort><creationdate>2024</creationdate><title>Optimized Tile Quality Selection in Multi-User 360° Video Streaming</title><author>Mahmoud, Moatasim ; Rizou, Stamatia ; Panayides, Andreas S. ; Kantartzis, Nikolaos V. ; Karagiannidis, George K. ; Lazaridis, Pavlos I. ; Zaharis, Zaharias D.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c1318-c1ef1dc431d59a0e381dd9bf5414dfc481cbaae29ea9897e0e58cd73afa29c63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>360° videos</topic><topic>Bandwidth</topic><topic>Bit rate</topic><topic>Measurement</topic><topic>Multicast communication</topic><topic>Optimization</topic><topic>Quality of experience</topic><topic>Resists</topic><topic>Streaming media</topic><topic>video quality assessment (VQA)</topic><topic>Video streaming</topic><topic>Virtual reality</topic><topic>virtual reality (VR)</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Mahmoud, Moatasim</creatorcontrib><creatorcontrib>Rizou, Stamatia</creatorcontrib><creatorcontrib>Panayides, Andreas S.</creatorcontrib><creatorcontrib>Kantartzis, Nikolaos V.</creatorcontrib><creatorcontrib>Karagiannidis, George K.</creatorcontrib><creatorcontrib>Lazaridis, Pavlos I.</creatorcontrib><creatorcontrib>Zaharis, Zaharias D.</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Xplore Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Xplore (Online service)</collection><collection>CrossRef</collection><collection>Open Access: DOAJ - Directory of Open Access Journals</collection><jtitle>IEEE open journal of the Communications Society</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mahmoud, Moatasim</au><au>Rizou, Stamatia</au><au>Panayides, Andreas S.</au><au>Kantartzis, Nikolaos V.</au><au>Karagiannidis, George K.</au><au>Lazaridis, Pavlos I.</au><au>Zaharis, Zaharias D.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Optimized Tile Quality Selection in Multi-User 360° Video Streaming</atitle><jtitle>IEEE open journal of the Communications Society</jtitle><stitle>OJCOMS</stitle><date>2024</date><risdate>2024</risdate><volume>5</volume><spage>7301</spage><epage>7316</epage><pages>7301-7316</pages><issn>2644-125X</issn><eissn>2644-125X</eissn><coden>IOJCAZ</coden><abstract>360° videos and virtual reality (VR) are among the defining applications for a new era of immersive multimedia technologies. However, streaming high-quality 360° videos constitutes a challenge for service providers and network operators, especially in multi-user scenarios. The massive data rates and the unique features of omnidirectional videos necessitate the development of novel streaming techniques. In this paper, we propose an optimized multi-user tiled 360° video streaming framework. Specifically, we formulate the problem of tile quality selection in multi-user bandwidth-constrained communications and propose an algorithm that assigns the quality levels of transmitted tiles. The proposed framework is designed to maximize the perceived quality within the users' viewports by considering 360° video quality assessment (360° VQA) metrics and tile viewing percentages. To simulate our solution in practical settings, we employ a long short-term memory (LSTM) model to perform viewport prediction and make the assessment based on real-life viewing data. Simulation results of our proposed framework show significant improvement in the delivered viewports' quality and robustness against increasing the number of users.</abstract><pub>IEEE</pub><doi>10.1109/OJCOMS.2024.3498334</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0003-0959-7838</orcidid><orcidid>https://orcid.org/0000-0001-5091-2567</orcidid><orcidid>https://orcid.org/0009-0002-7552-5533</orcidid><orcidid>https://orcid.org/0000-0002-4548-282X</orcidid><orcidid>https://orcid.org/0000-0001-9829-7946</orcidid><orcidid>https://orcid.org/0000-0001-8810-0345</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2644-125X
ispartof IEEE open journal of the Communications Society, 2024, Vol.5, p.7301-7316
issn 2644-125X
2644-125X
language eng
recordid cdi_ieee_primary_10753298
source IEEE Xplore Open Access Journals
subjects 360° videos
Bandwidth
Bit rate
Measurement
Multicast communication
Optimization
Quality of experience
Resists
Streaming media
video quality assessment (VQA)
Video streaming
Virtual reality
virtual reality (VR)
title Optimized Tile Quality Selection in Multi-User 360° Video Streaming
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T06%3A05%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-doaj_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Optimized%20Tile%20Quality%20Selection%20in%20Multi-User%20360%C2%B0%20Video%20Streaming&rft.jtitle=IEEE%20open%20journal%20of%20the%20Communications%20Society&rft.au=Mahmoud,%20Moatasim&rft.date=2024&rft.volume=5&rft.spage=7301&rft.epage=7316&rft.pages=7301-7316&rft.issn=2644-125X&rft.eissn=2644-125X&rft.coden=IOJCAZ&rft_id=info:doi/10.1109/OJCOMS.2024.3498334&rft_dat=%3Cdoaj_ieee_%3Eoai_doaj_org_article_36baa2a4d48d408a9de171e16e6ca14b%3C/doaj_ieee_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c1318-c1ef1dc431d59a0e381dd9bf5414dfc481cbaae29ea9897e0e58cd73afa29c63%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10753298&rfr_iscdi=true