Loading…

ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement

Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work p...

Full description

Saved in:
Bibliographic Details
Published in:Sensors (Basel, Switzerland) Switzerland), 2022-10, Vol.22 (20), p.7932
Main Authors: Gu, Jiqing, Song, Chao, Dai, Haipeng, Shi, Lei, Wu, Jinqiu, Lu, Li
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313
container_end_page
container_issue 20
container_start_page 7932
container_title Sensors (Basel, Switzerland)
container_volume 22
creator Gu, Jiqing
Song, Chao
Dai, Haipeng
Shi, Lei
Wu, Jinqiu
Lu, Li
description Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.
doi_str_mv 10.3390/s22207932
format article
fullrecord <record><control><sourceid>gale_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_7fc24b7ce52143dfa9881460b5d77359</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A746532891</galeid><doaj_id>oai_doaj_org_article_7fc24b7ce52143dfa9881460b5d77359</doaj_id><sourcerecordid>A746532891</sourcerecordid><originalsourceid>FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313</originalsourceid><addsrcrecordid>eNpdUstu1TAUjBBIlMKCP4jEBhYpfj9YIEWXV6UWFoCQ2FiOfXzxJYmLnbTq3-PbW1UUeWF7PB7PGZ-meY7RCaUavS6EECQ1JQ-aI8wI61TdP_xn_bh5UsoOIUIpVUfNz35z_qbtnVuzddddf2UztJs0jnZI2S7xEtrzNMcl5Thv25By-zWFZc_q3kGIM_j2MyxXKf_ufkRfyWDLmmGCeXnaPAp2LPDsdj5uvn94_23zqTv78vF00591jjG-dFhRbWV1BoIKDopoFZgXFSTEYwqMeJBWBz5Yhr2kOliitEUiCCYxxfS4OT3o-mR35iLHyeZrk2w0N0DKW2PzEt0IRgZH2CAdcIIZ9cFqpTATaOBeSsp11Xp70LpYhwm8q2VkO94TvX8yx19mmy6NFrgmKqrAy1uBnP6sUBYzxeKg5jlDWoshkmiOq29VqS_-o-7Smuca1Z6lOEXqxtHJgbW1tYA4h1TfdXV4mKJLc_2EiveSCU5rLvs4Xh0uuJxKyRDu3GNk9j1i7nqE_gXrj6yk</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2728530859</pqid></control><display><type>article</type><title>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</title><source>Open Access: PubMed Central</source><source>Publicly Available Content Database</source><creator>Gu, Jiqing ; Song, Chao ; Dai, Haipeng ; Shi, Lei ; Wu, Jinqiu ; Lu, Li</creator><creatorcontrib>Gu, Jiqing ; Song, Chao ; Dai, Haipeng ; Shi, Lei ; Wu, Jinqiu ; Lu, Li</creatorcontrib><description>Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.</description><identifier>ISSN: 1424-8220</identifier><identifier>EISSN: 1424-8220</identifier><identifier>DOI: 10.3390/s22207932</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Accuracy ; Algorithms ; Approximation ; Collaboration ; collaborative monitoring ; Count–Min sketch ; large flows ; Load balancing ; Measurement ; Monitoring ; Monitors ; Operators (mathematics) ; Sketches ; Software ; software-defined network-wide measurement ; Software-defined networking ; Technology application ; Traffic congestion ; Virtual private networks</subject><ispartof>Sensors (Basel, Switzerland), 2022-10, Vol.22 (20), p.7932</ispartof><rights>COPYRIGHT 2022 MDPI AG</rights><rights>2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2022 by the authors. 2022</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313</cites><orcidid>0000-0002-8602-3996</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2728530859/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2728530859?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,25752,27923,27924,37011,37012,44589,53790,53792,74897</link.rule.ids></links><search><creatorcontrib>Gu, Jiqing</creatorcontrib><creatorcontrib>Song, Chao</creatorcontrib><creatorcontrib>Dai, Haipeng</creatorcontrib><creatorcontrib>Shi, Lei</creatorcontrib><creatorcontrib>Wu, Jinqiu</creatorcontrib><creatorcontrib>Lu, Li</creatorcontrib><title>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</title><title>Sensors (Basel, Switzerland)</title><description>Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.</description><subject>Accuracy</subject><subject>Algorithms</subject><subject>Approximation</subject><subject>Collaboration</subject><subject>collaborative monitoring</subject><subject>Count–Min sketch</subject><subject>large flows</subject><subject>Load balancing</subject><subject>Measurement</subject><subject>Monitoring</subject><subject>Monitors</subject><subject>Operators (mathematics)</subject><subject>Sketches</subject><subject>Software</subject><subject>software-defined network-wide measurement</subject><subject>Software-defined networking</subject><subject>Technology application</subject><subject>Traffic congestion</subject><subject>Virtual private networks</subject><issn>1424-8220</issn><issn>1424-8220</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNpdUstu1TAUjBBIlMKCP4jEBhYpfj9YIEWXV6UWFoCQ2FiOfXzxJYmLnbTq3-PbW1UUeWF7PB7PGZ-meY7RCaUavS6EECQ1JQ-aI8wI61TdP_xn_bh5UsoOIUIpVUfNz35z_qbtnVuzddddf2UztJs0jnZI2S7xEtrzNMcl5Thv25By-zWFZc_q3kGIM_j2MyxXKf_ufkRfyWDLmmGCeXnaPAp2LPDsdj5uvn94_23zqTv78vF00591jjG-dFhRbWV1BoIKDopoFZgXFSTEYwqMeJBWBz5Yhr2kOliitEUiCCYxxfS4OT3o-mR35iLHyeZrk2w0N0DKW2PzEt0IRgZH2CAdcIIZ9cFqpTATaOBeSsp11Xp70LpYhwm8q2VkO94TvX8yx19mmy6NFrgmKqrAy1uBnP6sUBYzxeKg5jlDWoshkmiOq29VqS_-o-7Smuca1Z6lOEXqxtHJgbW1tYA4h1TfdXV4mKJLc_2EiveSCU5rLvs4Xh0uuJxKyRDu3GNk9j1i7nqE_gXrj6yk</recordid><startdate>20221001</startdate><enddate>20221001</enddate><creator>Gu, Jiqing</creator><creator>Song, Chao</creator><creator>Dai, Haipeng</creator><creator>Shi, Lei</creator><creator>Wu, Jinqiu</creator><creator>Lu, Li</creator><general>MDPI AG</general><general>MDPI</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>M0S</scope><scope>M1P</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-8602-3996</orcidid></search><sort><creationdate>20221001</creationdate><title>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</title><author>Gu, Jiqing ; Song, Chao ; Dai, Haipeng ; Shi, Lei ; Wu, Jinqiu ; Lu, Li</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Accuracy</topic><topic>Algorithms</topic><topic>Approximation</topic><topic>Collaboration</topic><topic>collaborative monitoring</topic><topic>Count–Min sketch</topic><topic>large flows</topic><topic>Load balancing</topic><topic>Measurement</topic><topic>Monitoring</topic><topic>Monitors</topic><topic>Operators (mathematics)</topic><topic>Sketches</topic><topic>Software</topic><topic>software-defined network-wide measurement</topic><topic>Software-defined networking</topic><topic>Technology application</topic><topic>Traffic congestion</topic><topic>Virtual private networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gu, Jiqing</creatorcontrib><creatorcontrib>Song, Chao</creatorcontrib><creatorcontrib>Dai, Haipeng</creatorcontrib><creatorcontrib>Shi, Lei</creatorcontrib><creatorcontrib>Wu, Jinqiu</creatorcontrib><creatorcontrib>Lu, Li</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>Directory of Open Access Journals</collection><jtitle>Sensors (Basel, Switzerland)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gu, Jiqing</au><au>Song, Chao</au><au>Dai, Haipeng</au><au>Shi, Lei</au><au>Wu, Jinqiu</au><au>Lu, Li</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</atitle><jtitle>Sensors (Basel, Switzerland)</jtitle><date>2022-10-01</date><risdate>2022</risdate><volume>22</volume><issue>20</issue><spage>7932</spage><pages>7932-</pages><issn>1424-8220</issn><eissn>1424-8220</eissn><abstract>Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/s22207932</doi><orcidid>https://orcid.org/0000-0002-8602-3996</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1424-8220
ispartof Sensors (Basel, Switzerland), 2022-10, Vol.22 (20), p.7932
issn 1424-8220
1424-8220
language eng
recordid cdi_doaj_primary_oai_doaj_org_article_7fc24b7ce52143dfa9881460b5d77359
source Open Access: PubMed Central; Publicly Available Content Database
subjects Accuracy
Algorithms
Approximation
Collaboration
collaborative monitoring
Count–Min sketch
large flows
Load balancing
Measurement
Monitoring
Monitors
Operators (mathematics)
Sketches
Software
software-defined network-wide measurement
Software-defined networking
Technology application
Traffic congestion
Virtual private networks
title ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T01%3A39%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=ACM:%20Accuracy-Aware%20Collaborative%20Monitoring%20for%20Software-Defined%20Network-Wide%20Measurement&rft.jtitle=Sensors%20(Basel,%20Switzerland)&rft.au=Gu,%20Jiqing&rft.date=2022-10-01&rft.volume=22&rft.issue=20&rft.spage=7932&rft.pages=7932-&rft.issn=1424-8220&rft.eissn=1424-8220&rft_id=info:doi/10.3390/s22207932&rft_dat=%3Cgale_doaj_%3EA746532891%3C/gale_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2728530859&rft_id=info:pmid/&rft_galeid=A746532891&rfr_iscdi=true