Loading…
An automated toolchain for the data-driven and dynamical modeling of combined sewer systems
The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimat...
Saved in:
Published in: | Water research (Oxford) 2017-12, Vol.126, p.88-100 |
---|---|
Main Authors: | , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643 |
---|---|
cites | cdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643 |
container_end_page | 100 |
container_issue | |
container_start_page | 88 |
container_title | Water research (Oxford) |
container_volume | 126 |
creator | Troutman, Sara C. Schambach, Nathaniel Love, Nancy G. Kerkez, Branko |
description | The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach.
•A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system. |
doi_str_mv | 10.1016/j.watres.2017.08.065 |
format | article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1940597385</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0043135417307297</els_id><sourcerecordid>1940597385</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</originalsourceid><addsrcrecordid>eNp9kDFv2zAQhYmiQeOk_QdFwbGLlKNISdRSwAjSJECALMnUgTiRp4aGJLok7cD_vgrsdOx0y_few32MfRVQChDN1aZ8xRwplRWItgRdQlN_YCuh266olNIf2QpAyULIWp2zi5Q2AFBVsvvEzivdVVJBu2K_1jPHXQ4TZnI8hzDaF_QzH0Lk-YW4w4yFi35PCzc77g4zTt7iyKfgaPTzbx4GbsPU-3kpSPRKkadDyjSlz-xswDHRl9O9ZM8_b56u74qHx9v76_VDYRXoXNhGQi8QsXFYqbpHrVqnUZB1FrqhHyqFAqhBiwsJtZW2laSgs50m1yh5yb4fe7cx_NlRymbyydI44kxhl4zoFNRdK3W9oOqI2hhSijSYbfQTxoMRYN60mo05ajVvWg1os2hdYt9OC7t-Ivcv9O5xAX4cAVr-3HuKJllPsyXnI9lsXPD_X_gLJfuMjw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1940597385</pqid></control><display><type>article</type><title>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</title><source>ScienceDirect Freedom Collection</source><creator>Troutman, Sara C. ; Schambach, Nathaniel ; Love, Nancy G. ; Kerkez, Branko</creator><creatorcontrib>Troutman, Sara C. ; Schambach, Nathaniel ; Love, Nancy G. ; Kerkez, Branko</creatorcontrib><description>The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach.
•A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.</description><identifier>ISSN: 0043-1354</identifier><identifier>EISSN: 1879-2448</identifier><identifier>DOI: 10.1016/j.watres.2017.08.065</identifier><identifier>PMID: 28923407</identifier><language>eng</language><publisher>England: Elsevier Ltd</publisher><subject>Calibration ; Combined sewer ; Data-driven modeling ; Hydrology - methods ; Models, Theoretical ; Rain ; Sensor networks ; Sewage ; Smart water systems ; Waste Management - methods ; Waste Water ; Weather</subject><ispartof>Water research (Oxford), 2017-12, Vol.126, p.88-100</ispartof><rights>2017 Elsevier Ltd</rights><rights>Copyright © 2017 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</citedby><cites>FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</cites><orcidid>0000-0002-6809-7959</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28923407$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Troutman, Sara C.</creatorcontrib><creatorcontrib>Schambach, Nathaniel</creatorcontrib><creatorcontrib>Love, Nancy G.</creatorcontrib><creatorcontrib>Kerkez, Branko</creatorcontrib><title>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</title><title>Water research (Oxford)</title><addtitle>Water Res</addtitle><description>The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach.
•A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.</description><subject>Calibration</subject><subject>Combined sewer</subject><subject>Data-driven modeling</subject><subject>Hydrology - methods</subject><subject>Models, Theoretical</subject><subject>Rain</subject><subject>Sensor networks</subject><subject>Sewage</subject><subject>Smart water systems</subject><subject>Waste Management - methods</subject><subject>Waste Water</subject><subject>Weather</subject><issn>0043-1354</issn><issn>1879-2448</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><recordid>eNp9kDFv2zAQhYmiQeOk_QdFwbGLlKNISdRSwAjSJECALMnUgTiRp4aGJLok7cD_vgrsdOx0y_few32MfRVQChDN1aZ8xRwplRWItgRdQlN_YCuh266olNIf2QpAyULIWp2zi5Q2AFBVsvvEzivdVVJBu2K_1jPHXQ4TZnI8hzDaF_QzH0Lk-YW4w4yFi35PCzc77g4zTt7iyKfgaPTzbx4GbsPU-3kpSPRKkadDyjSlz-xswDHRl9O9ZM8_b56u74qHx9v76_VDYRXoXNhGQi8QsXFYqbpHrVqnUZB1FrqhHyqFAqhBiwsJtZW2laSgs50m1yh5yb4fe7cx_NlRymbyydI44kxhl4zoFNRdK3W9oOqI2hhSijSYbfQTxoMRYN60mo05ajVvWg1os2hdYt9OC7t-Ivcv9O5xAX4cAVr-3HuKJllPsyXnI9lsXPD_X_gLJfuMjw</recordid><startdate>20171201</startdate><enddate>20171201</enddate><creator>Troutman, Sara C.</creator><creator>Schambach, Nathaniel</creator><creator>Love, Nancy G.</creator><creator>Kerkez, Branko</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-6809-7959</orcidid></search><sort><creationdate>20171201</creationdate><title>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</title><author>Troutman, Sara C. ; Schambach, Nathaniel ; Love, Nancy G. ; Kerkez, Branko</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Calibration</topic><topic>Combined sewer</topic><topic>Data-driven modeling</topic><topic>Hydrology - methods</topic><topic>Models, Theoretical</topic><topic>Rain</topic><topic>Sensor networks</topic><topic>Sewage</topic><topic>Smart water systems</topic><topic>Waste Management - methods</topic><topic>Waste Water</topic><topic>Weather</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Troutman, Sara C.</creatorcontrib><creatorcontrib>Schambach, Nathaniel</creatorcontrib><creatorcontrib>Love, Nancy G.</creatorcontrib><creatorcontrib>Kerkez, Branko</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Water research (Oxford)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Troutman, Sara C.</au><au>Schambach, Nathaniel</au><au>Love, Nancy G.</au><au>Kerkez, Branko</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</atitle><jtitle>Water research (Oxford)</jtitle><addtitle>Water Res</addtitle><date>2017-12-01</date><risdate>2017</risdate><volume>126</volume><spage>88</spage><epage>100</epage><pages>88-100</pages><issn>0043-1354</issn><eissn>1879-2448</eissn><abstract>The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach.
•A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.</abstract><cop>England</cop><pub>Elsevier Ltd</pub><pmid>28923407</pmid><doi>10.1016/j.watres.2017.08.065</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-6809-7959</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0043-1354 |
ispartof | Water research (Oxford), 2017-12, Vol.126, p.88-100 |
issn | 0043-1354 1879-2448 |
language | eng |
recordid | cdi_proquest_miscellaneous_1940597385 |
source | ScienceDirect Freedom Collection |
subjects | Calibration Combined sewer Data-driven modeling Hydrology - methods Models, Theoretical Rain Sensor networks Sewage Smart water systems Waste Management - methods Waste Water Weather |
title | An automated toolchain for the data-driven and dynamical modeling of combined sewer systems |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T07%3A49%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20automated%20toolchain%20for%20the%20data-driven%20and%20dynamical%20modeling%20of%20combined%20sewer%20systems&rft.jtitle=Water%20research%20(Oxford)&rft.au=Troutman,%20Sara%20C.&rft.date=2017-12-01&rft.volume=126&rft.spage=88&rft.epage=100&rft.pages=88-100&rft.issn=0043-1354&rft.eissn=1879-2448&rft_id=info:doi/10.1016/j.watres.2017.08.065&rft_dat=%3Cproquest_cross%3E1940597385%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1940597385&rft_id=info:pmid/28923407&rfr_iscdi=true |