Loading…
ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement
Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work p...
Saved in:
Published in: | Sensors (Basel, Switzerland) Switzerland), 2022-10, Vol.22 (20), p.7932 |
---|---|
Main Authors: | , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | cdi_FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313 |
container_end_page | |
container_issue | 20 |
container_start_page | 7932 |
container_title | Sensors (Basel, Switzerland) |
container_volume | 22 |
creator | Gu, Jiqing Song, Chao Dai, Haipeng Shi, Lei Wu, Jinqiu Lu, Li |
description | Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms. |
doi_str_mv | 10.3390/s22207932 |
format | article |
fullrecord | <record><control><sourceid>gale_doaj_</sourceid><recordid>TN_cdi_doaj_primary_oai_doaj_org_article_7fc24b7ce52143dfa9881460b5d77359</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A746532891</galeid><doaj_id>oai_doaj_org_article_7fc24b7ce52143dfa9881460b5d77359</doaj_id><sourcerecordid>A746532891</sourcerecordid><originalsourceid>FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313</originalsourceid><addsrcrecordid>eNpdUstu1TAUjBBIlMKCP4jEBhYpfj9YIEWXV6UWFoCQ2FiOfXzxJYmLnbTq3-PbW1UUeWF7PB7PGZ-meY7RCaUavS6EECQ1JQ-aI8wI61TdP_xn_bh5UsoOIUIpVUfNz35z_qbtnVuzddddf2UztJs0jnZI2S7xEtrzNMcl5Thv25By-zWFZc_q3kGIM_j2MyxXKf_ufkRfyWDLmmGCeXnaPAp2LPDsdj5uvn94_23zqTv78vF00591jjG-dFhRbWV1BoIKDopoFZgXFSTEYwqMeJBWBz5Yhr2kOliitEUiCCYxxfS4OT3o-mR35iLHyeZrk2w0N0DKW2PzEt0IRgZH2CAdcIIZ9cFqpTATaOBeSsp11Xp70LpYhwm8q2VkO94TvX8yx19mmy6NFrgmKqrAy1uBnP6sUBYzxeKg5jlDWoshkmiOq29VqS_-o-7Smuca1Z6lOEXqxtHJgbW1tYA4h1TfdXV4mKJLc_2EiveSCU5rLvs4Xh0uuJxKyRDu3GNk9j1i7nqE_gXrj6yk</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2728530859</pqid></control><display><type>article</type><title>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</title><source>Open Access: PubMed Central</source><source>Publicly Available Content Database</source><creator>Gu, Jiqing ; Song, Chao ; Dai, Haipeng ; Shi, Lei ; Wu, Jinqiu ; Lu, Li</creator><creatorcontrib>Gu, Jiqing ; Song, Chao ; Dai, Haipeng ; Shi, Lei ; Wu, Jinqiu ; Lu, Li</creatorcontrib><description>Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.</description><identifier>ISSN: 1424-8220</identifier><identifier>EISSN: 1424-8220</identifier><identifier>DOI: 10.3390/s22207932</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Accuracy ; Algorithms ; Approximation ; Collaboration ; collaborative monitoring ; Count–Min sketch ; large flows ; Load balancing ; Measurement ; Monitoring ; Monitors ; Operators (mathematics) ; Sketches ; Software ; software-defined network-wide measurement ; Software-defined networking ; Technology application ; Traffic congestion ; Virtual private networks</subject><ispartof>Sensors (Basel, Switzerland), 2022-10, Vol.22 (20), p.7932</ispartof><rights>COPYRIGHT 2022 MDPI AG</rights><rights>2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2022 by the authors. 2022</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313</cites><orcidid>0000-0002-8602-3996</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2728530859/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2728530859?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,25752,27923,27924,37011,37012,44589,53790,53792,74897</link.rule.ids></links><search><creatorcontrib>Gu, Jiqing</creatorcontrib><creatorcontrib>Song, Chao</creatorcontrib><creatorcontrib>Dai, Haipeng</creatorcontrib><creatorcontrib>Shi, Lei</creatorcontrib><creatorcontrib>Wu, Jinqiu</creatorcontrib><creatorcontrib>Lu, Li</creatorcontrib><title>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</title><title>Sensors (Basel, Switzerland)</title><description>Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.</description><subject>Accuracy</subject><subject>Algorithms</subject><subject>Approximation</subject><subject>Collaboration</subject><subject>collaborative monitoring</subject><subject>Count–Min sketch</subject><subject>large flows</subject><subject>Load balancing</subject><subject>Measurement</subject><subject>Monitoring</subject><subject>Monitors</subject><subject>Operators (mathematics)</subject><subject>Sketches</subject><subject>Software</subject><subject>software-defined network-wide measurement</subject><subject>Software-defined networking</subject><subject>Technology application</subject><subject>Traffic congestion</subject><subject>Virtual private networks</subject><issn>1424-8220</issn><issn>1424-8220</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><sourceid>DOA</sourceid><recordid>eNpdUstu1TAUjBBIlMKCP4jEBhYpfj9YIEWXV6UWFoCQ2FiOfXzxJYmLnbTq3-PbW1UUeWF7PB7PGZ-meY7RCaUavS6EECQ1JQ-aI8wI61TdP_xn_bh5UsoOIUIpVUfNz35z_qbtnVuzddddf2UztJs0jnZI2S7xEtrzNMcl5Thv25By-zWFZc_q3kGIM_j2MyxXKf_ufkRfyWDLmmGCeXnaPAp2LPDsdj5uvn94_23zqTv78vF00591jjG-dFhRbWV1BoIKDopoFZgXFSTEYwqMeJBWBz5Yhr2kOliitEUiCCYxxfS4OT3o-mR35iLHyeZrk2w0N0DKW2PzEt0IRgZH2CAdcIIZ9cFqpTATaOBeSsp11Xp70LpYhwm8q2VkO94TvX8yx19mmy6NFrgmKqrAy1uBnP6sUBYzxeKg5jlDWoshkmiOq29VqS_-o-7Smuca1Z6lOEXqxtHJgbW1tYA4h1TfdXV4mKJLc_2EiveSCU5rLvs4Xh0uuJxKyRDu3GNk9j1i7nqE_gXrj6yk</recordid><startdate>20221001</startdate><enddate>20221001</enddate><creator>Gu, Jiqing</creator><creator>Song, Chao</creator><creator>Dai, Haipeng</creator><creator>Shi, Lei</creator><creator>Wu, Jinqiu</creator><creator>Lu, Li</creator><general>MDPI AG</general><general>MDPI</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>K9.</scope><scope>M0S</scope><scope>M1P</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-8602-3996</orcidid></search><sort><creationdate>20221001</creationdate><title>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</title><author>Gu, Jiqing ; Song, Chao ; Dai, Haipeng ; Shi, Lei ; Wu, Jinqiu ; Lu, Li</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Accuracy</topic><topic>Algorithms</topic><topic>Approximation</topic><topic>Collaboration</topic><topic>collaborative monitoring</topic><topic>Count–Min sketch</topic><topic>large flows</topic><topic>Load balancing</topic><topic>Measurement</topic><topic>Monitoring</topic><topic>Monitors</topic><topic>Operators (mathematics)</topic><topic>Sketches</topic><topic>Software</topic><topic>software-defined network-wide measurement</topic><topic>Software-defined networking</topic><topic>Technology application</topic><topic>Traffic congestion</topic><topic>Virtual private networks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gu, Jiqing</creatorcontrib><creatorcontrib>Song, Chao</creatorcontrib><creatorcontrib>Dai, Haipeng</creatorcontrib><creatorcontrib>Shi, Lei</creatorcontrib><creatorcontrib>Wu, Jinqiu</creatorcontrib><creatorcontrib>Lu, Li</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>ProQuest Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>ProQuest Central Essentials</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>Directory of Open Access Journals</collection><jtitle>Sensors (Basel, Switzerland)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gu, Jiqing</au><au>Song, Chao</au><au>Dai, Haipeng</au><au>Shi, Lei</au><au>Wu, Jinqiu</au><au>Lu, Li</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement</atitle><jtitle>Sensors (Basel, Switzerland)</jtitle><date>2022-10-01</date><risdate>2022</risdate><volume>22</volume><issue>20</issue><spage>7932</spage><pages>7932-</pages><issn>1424-8220</issn><eissn>1424-8220</eissn><abstract>Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/s22207932</doi><orcidid>https://orcid.org/0000-0002-8602-3996</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1424-8220 |
ispartof | Sensors (Basel, Switzerland), 2022-10, Vol.22 (20), p.7932 |
issn | 1424-8220 1424-8220 |
language | eng |
recordid | cdi_doaj_primary_oai_doaj_org_article_7fc24b7ce52143dfa9881460b5d77359 |
source | Open Access: PubMed Central; Publicly Available Content Database |
subjects | Accuracy Algorithms Approximation Collaboration collaborative monitoring Count–Min sketch large flows Load balancing Measurement Monitoring Monitors Operators (mathematics) Sketches Software software-defined network-wide measurement Software-defined networking Technology application Traffic congestion Virtual private networks |
title | ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T01%3A39%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_doaj_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=ACM:%20Accuracy-Aware%20Collaborative%20Monitoring%20for%20Software-Defined%20Network-Wide%20Measurement&rft.jtitle=Sensors%20(Basel,%20Switzerland)&rft.au=Gu,%20Jiqing&rft.date=2022-10-01&rft.volume=22&rft.issue=20&rft.spage=7932&rft.pages=7932-&rft.issn=1424-8220&rft.eissn=1424-8220&rft_id=info:doi/10.3390/s22207932&rft_dat=%3Cgale_doaj_%3EA746532891%3C/gale_doaj_%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c445t-1839a7220e6365e8298f4d639a22d13e42de7a9f5ba41d739fa289a06f6471313%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2728530859&rft_id=info:pmid/&rft_galeid=A746532891&rfr_iscdi=true |