Loading…

An automated toolchain for the data-driven and dynamical modeling of combined sewer systems

The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimat...

Full description

Saved in:
Bibliographic Details
Published in:Water research (Oxford) 2017-12, Vol.126, p.88-100
Main Authors: Troutman, Sara C., Schambach, Nathaniel, Love, Nancy G., Kerkez, Branko
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643
cites cdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643
container_end_page 100
container_issue
container_start_page 88
container_title Water research (Oxford)
container_volume 126
creator Troutman, Sara C.
Schambach, Nathaniel
Love, Nancy G.
Kerkez, Branko
description The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach. •A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.
doi_str_mv 10.1016/j.watres.2017.08.065
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1940597385</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0043135417307297</els_id><sourcerecordid>1940597385</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</originalsourceid><addsrcrecordid>eNp9kDFv2zAQhYmiQeOk_QdFwbGLlKNISdRSwAjSJECALMnUgTiRp4aGJLok7cD_vgrsdOx0y_few32MfRVQChDN1aZ8xRwplRWItgRdQlN_YCuh266olNIf2QpAyULIWp2zi5Q2AFBVsvvEzivdVVJBu2K_1jPHXQ4TZnI8hzDaF_QzH0Lk-YW4w4yFi35PCzc77g4zTt7iyKfgaPTzbx4GbsPU-3kpSPRKkadDyjSlz-xswDHRl9O9ZM8_b56u74qHx9v76_VDYRXoXNhGQi8QsXFYqbpHrVqnUZB1FrqhHyqFAqhBiwsJtZW2laSgs50m1yh5yb4fe7cx_NlRymbyydI44kxhl4zoFNRdK3W9oOqI2hhSijSYbfQTxoMRYN60mo05ajVvWg1os2hdYt9OC7t-Ivcv9O5xAX4cAVr-3HuKJllPsyXnI9lsXPD_X_gLJfuMjw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1940597385</pqid></control><display><type>article</type><title>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</title><source>ScienceDirect Freedom Collection</source><creator>Troutman, Sara C. ; Schambach, Nathaniel ; Love, Nancy G. ; Kerkez, Branko</creator><creatorcontrib>Troutman, Sara C. ; Schambach, Nathaniel ; Love, Nancy G. ; Kerkez, Branko</creatorcontrib><description>The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach. •A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.</description><identifier>ISSN: 0043-1354</identifier><identifier>EISSN: 1879-2448</identifier><identifier>DOI: 10.1016/j.watres.2017.08.065</identifier><identifier>PMID: 28923407</identifier><language>eng</language><publisher>England: Elsevier Ltd</publisher><subject>Calibration ; Combined sewer ; Data-driven modeling ; Hydrology - methods ; Models, Theoretical ; Rain ; Sensor networks ; Sewage ; Smart water systems ; Waste Management - methods ; Waste Water ; Weather</subject><ispartof>Water research (Oxford), 2017-12, Vol.126, p.88-100</ispartof><rights>2017 Elsevier Ltd</rights><rights>Copyright © 2017 Elsevier Ltd. All rights reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</citedby><cites>FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</cites><orcidid>0000-0002-6809-7959</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/28923407$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Troutman, Sara C.</creatorcontrib><creatorcontrib>Schambach, Nathaniel</creatorcontrib><creatorcontrib>Love, Nancy G.</creatorcontrib><creatorcontrib>Kerkez, Branko</creatorcontrib><title>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</title><title>Water research (Oxford)</title><addtitle>Water Res</addtitle><description>The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach. •A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.</description><subject>Calibration</subject><subject>Combined sewer</subject><subject>Data-driven modeling</subject><subject>Hydrology - methods</subject><subject>Models, Theoretical</subject><subject>Rain</subject><subject>Sensor networks</subject><subject>Sewage</subject><subject>Smart water systems</subject><subject>Waste Management - methods</subject><subject>Waste Water</subject><subject>Weather</subject><issn>0043-1354</issn><issn>1879-2448</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2017</creationdate><recordtype>article</recordtype><recordid>eNp9kDFv2zAQhYmiQeOk_QdFwbGLlKNISdRSwAjSJECALMnUgTiRp4aGJLok7cD_vgrsdOx0y_few32MfRVQChDN1aZ8xRwplRWItgRdQlN_YCuh266olNIf2QpAyULIWp2zi5Q2AFBVsvvEzivdVVJBu2K_1jPHXQ4TZnI8hzDaF_QzH0Lk-YW4w4yFi35PCzc77g4zTt7iyKfgaPTzbx4GbsPU-3kpSPRKkadDyjSlz-xswDHRl9O9ZM8_b56u74qHx9v76_VDYRXoXNhGQi8QsXFYqbpHrVqnUZB1FrqhHyqFAqhBiwsJtZW2laSgs50m1yh5yb4fe7cx_NlRymbyydI44kxhl4zoFNRdK3W9oOqI2hhSijSYbfQTxoMRYN60mo05ajVvWg1os2hdYt9OC7t-Ivcv9O5xAX4cAVr-3HuKJllPsyXnI9lsXPD_X_gLJfuMjw</recordid><startdate>20171201</startdate><enddate>20171201</enddate><creator>Troutman, Sara C.</creator><creator>Schambach, Nathaniel</creator><creator>Love, Nancy G.</creator><creator>Kerkez, Branko</creator><general>Elsevier Ltd</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-6809-7959</orcidid></search><sort><creationdate>20171201</creationdate><title>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</title><author>Troutman, Sara C. ; Schambach, Nathaniel ; Love, Nancy G. ; Kerkez, Branko</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Calibration</topic><topic>Combined sewer</topic><topic>Data-driven modeling</topic><topic>Hydrology - methods</topic><topic>Models, Theoretical</topic><topic>Rain</topic><topic>Sensor networks</topic><topic>Sewage</topic><topic>Smart water systems</topic><topic>Waste Management - methods</topic><topic>Waste Water</topic><topic>Weather</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Troutman, Sara C.</creatorcontrib><creatorcontrib>Schambach, Nathaniel</creatorcontrib><creatorcontrib>Love, Nancy G.</creatorcontrib><creatorcontrib>Kerkez, Branko</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Water research (Oxford)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Troutman, Sara C.</au><au>Schambach, Nathaniel</au><au>Love, Nancy G.</au><au>Kerkez, Branko</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An automated toolchain for the data-driven and dynamical modeling of combined sewer systems</atitle><jtitle>Water research (Oxford)</jtitle><addtitle>Water Res</addtitle><date>2017-12-01</date><risdate>2017</risdate><volume>126</volume><spage>88</spage><epage>100</epage><pages>88-100</pages><issn>0043-1354</issn><eissn>1879-2448</eissn><abstract>The recent availability and affordability of sensors and wireless communications is poised to transform our understanding and management of water systems. This will enable a new generation of adaptive water models that can ingest large quantities of sensor feeds and provide the best possible estimates of current and future conditions. To that end, this paper presents a novel data-driven identification/learning toolchain for combined sewer and stormwater systems. The toolchain uses Gaussian Processes to model dry-weather flows (domestic wastewater) and dynamical System Identification to represent wet-weather flows (rainfall runoff). By using a large and high-resolution sensor dataset across a real-world combined sewer system, we illustrate that relatively simple models can achieve good forecasting performance, subject to a finely-tuned and continuous re-calibration procedure. The data requirements of the proposed toolchain are evaluated, showing sensitivity to spatial heterogeneity and unique time-scales across which models of individual sites remain representative. We identify a near-optimal time record, or data “age,” for which historical measurements must be available to ensure good forecasting performance. We also show that more data do not always lead to a better model due to system uncertainty, such as shifts in climate or seasonal wastewater patterns. Furthermore, the individual components of the model (wet- and dry-weather) often require different volumes of historical observations for optimal forecasting performance, thus highlighting the need for a flexible re-calibration toolchain rather than a one-size-fits-all approach. •A data-driven toolchain to forecast wet and dry ows in combined sewer systems.•Characterization of system uncertainty given the changing nature of water systems.•Discussion of how often models need to be re-calibrated to react the water system.</abstract><cop>England</cop><pub>Elsevier Ltd</pub><pmid>28923407</pmid><doi>10.1016/j.watres.2017.08.065</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0002-6809-7959</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0043-1354
ispartof Water research (Oxford), 2017-12, Vol.126, p.88-100
issn 0043-1354
1879-2448
language eng
recordid cdi_proquest_miscellaneous_1940597385
source ScienceDirect Freedom Collection
subjects Calibration
Combined sewer
Data-driven modeling
Hydrology - methods
Models, Theoretical
Rain
Sensor networks
Sewage
Smart water systems
Waste Management - methods
Waste Water
Weather
title An automated toolchain for the data-driven and dynamical modeling of combined sewer systems
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-04T07%3A49%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20automated%20toolchain%20for%20the%20data-driven%20and%20dynamical%20modeling%20of%20combined%20sewer%20systems&rft.jtitle=Water%20research%20(Oxford)&rft.au=Troutman,%20Sara%20C.&rft.date=2017-12-01&rft.volume=126&rft.spage=88&rft.epage=100&rft.pages=88-100&rft.issn=0043-1354&rft.eissn=1879-2448&rft_id=info:doi/10.1016/j.watres.2017.08.065&rft_dat=%3Cproquest_cross%3E1940597385%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c408t-c630b1aaa6da245ba847d8a1ecdc09fbf24a10e6aca63005c3c73e409c98ed643%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1940597385&rft_id=info:pmid/28923407&rfr_iscdi=true