Loading…

Coriolis: enabling metagenomic classification on lightweight mobile devices

Abstract Motivation The introduction of portable DNA sequencers such as the Oxford Nanopore Technologies MinION has enabled real-time and in the field DNA sequencing. However, in the field sequencing is actionable only when coupled with in the field DNA classification. This poses new challenges for...

Full description

Saved in:
Bibliographic Details
Published in:Bioinformatics (Oxford, England) England), 2023-06, Vol.39 (Supplement_1), p.i66-i75
Main Authors: Mikalsen, Andrew J, Zola, Jaroslaw
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3
cites cdi_FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3
container_end_page i75
container_issue Supplement_1
container_start_page i66
container_title Bioinformatics (Oxford, England)
container_volume 39
creator Mikalsen, Andrew J
Zola, Jaroslaw
description Abstract Motivation The introduction of portable DNA sequencers such as the Oxford Nanopore Technologies MinION has enabled real-time and in the field DNA sequencing. However, in the field sequencing is actionable only when coupled with in the field DNA classification. This poses new challenges for metagenomic software since mobile deployments are typically in remote locations with limited network connectivity and without access to capable computing devices. Results We propose new strategies to enable in the field metagenomic classification on mobile devices. We first introduce a programming model for expressing metagenomic classifiers that decomposes the classification process into well-defined and manageable abstractions. The model simplifies resource management in mobile setups and enables rapid prototyping of classification algorithms. Next, we introduce the compact string B-tree, a practical data structure for indexing text in external storage, and we demonstrate its viability as a strategy to deploy massive DNA databases on memory-constrained devices. Finally, we combine both solutions into Coriolis, a metagenomic classifier designed specifically to operate on lightweight mobile devices. Through experiments with actual MinION metagenomic reads and a portable supercomputer-on-a-chip, we show that compared with the state-of-the-art solutions Coriolis offers higher throughput and lower resource consumption without sacrificing quality of classification. Availability and implementation Source code and test data are available from http://score-group.org/?id=smarten.
doi_str_mv 10.1093/bioinformatics/btad243
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10311295</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><oup_id>10.1093/bioinformatics/btad243</oup_id><sourcerecordid>2832577112</sourcerecordid><originalsourceid>FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3</originalsourceid><addsrcrecordid>eNqNkctOwzAQRS0EolD4hSpLNqV-xgkbhCpeohIbWFu2M0mNnLjESRF_T6qWiu6QRp6RfObO2BehCcHXBOdsZlxwTRnaWnfOxpnpdEE5O0JnhKVyyjNCjvc1ZiN0HuMHxlhgkZ6iEZMsk4TmZ-hlHloXvIs3CTTaeNdUSQ2drqAJtbOJ9TpGVzo7zAlNMoR31bL7gs2Z1ME4D0kBa2chXqCTUvsIl7s8Ru8P92_zp-ni9fF5freYWi5kN01NWgoKpck5zXQBTEiiOWWGmIxLnRZFbrjmxuRlXmDBS2wyMIZIajhnrGBjdLvVXfWmhsJC07Xaq1Xrat1-q6CdOrxp3FJVYa0IZmR4tRgUrnYKbfjsIXaqdtGC97qB0EdFM0aFlAM8oOkWtW2IsYVyP4dgtbFCHVqhdlYMjZO_W-7bfv9-AMgWCP3qv6I_qWWfdg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2832577112</pqid></control><display><type>article</type><title>Coriolis: enabling metagenomic classification on lightweight mobile devices</title><source>OUP_牛津大学出版社OA刊</source><source>PubMed Central</source><creator>Mikalsen, Andrew J ; Zola, Jaroslaw</creator><creatorcontrib>Mikalsen, Andrew J ; Zola, Jaroslaw</creatorcontrib><description>Abstract Motivation The introduction of portable DNA sequencers such as the Oxford Nanopore Technologies MinION has enabled real-time and in the field DNA sequencing. However, in the field sequencing is actionable only when coupled with in the field DNA classification. This poses new challenges for metagenomic software since mobile deployments are typically in remote locations with limited network connectivity and without access to capable computing devices. Results We propose new strategies to enable in the field metagenomic classification on mobile devices. We first introduce a programming model for expressing metagenomic classifiers that decomposes the classification process into well-defined and manageable abstractions. The model simplifies resource management in mobile setups and enables rapid prototyping of classification algorithms. Next, we introduce the compact string B-tree, a practical data structure for indexing text in external storage, and we demonstrate its viability as a strategy to deploy massive DNA databases on memory-constrained devices. Finally, we combine both solutions into Coriolis, a metagenomic classifier designed specifically to operate on lightweight mobile devices. Through experiments with actual MinION metagenomic reads and a portable supercomputer-on-a-chip, we show that compared with the state-of-the-art solutions Coriolis offers higher throughput and lower resource consumption without sacrificing quality of classification. Availability and implementation Source code and test data are available from http://score-group.org/?id=smarten.</description><identifier>ISSN: 1367-4803</identifier><identifier>EISSN: 1367-4811</identifier><identifier>DOI: 10.1093/bioinformatics/btad243</identifier><identifier>PMID: 37387129</identifier><language>eng</language><publisher>England: Oxford University Press</publisher><subject>Algorithms ; Bioinformatics of Microbes and Microbiomes ; Computers, Handheld ; Databases, Nucleic Acid ; Metagenome ; Metagenomics</subject><ispartof>Bioinformatics (Oxford, England), 2023-06, Vol.39 (Supplement_1), p.i66-i75</ispartof><rights>The Author(s) 2023. Published by Oxford University Press. 2023</rights><rights>The Author(s) 2023. Published by Oxford University Press.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3</citedby><cites>FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10311295/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10311295/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,314,727,780,784,885,1604,27924,27925,53791,53793</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/37387129$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Mikalsen, Andrew J</creatorcontrib><creatorcontrib>Zola, Jaroslaw</creatorcontrib><title>Coriolis: enabling metagenomic classification on lightweight mobile devices</title><title>Bioinformatics (Oxford, England)</title><addtitle>Bioinformatics</addtitle><description>Abstract Motivation The introduction of portable DNA sequencers such as the Oxford Nanopore Technologies MinION has enabled real-time and in the field DNA sequencing. However, in the field sequencing is actionable only when coupled with in the field DNA classification. This poses new challenges for metagenomic software since mobile deployments are typically in remote locations with limited network connectivity and without access to capable computing devices. Results We propose new strategies to enable in the field metagenomic classification on mobile devices. We first introduce a programming model for expressing metagenomic classifiers that decomposes the classification process into well-defined and manageable abstractions. The model simplifies resource management in mobile setups and enables rapid prototyping of classification algorithms. Next, we introduce the compact string B-tree, a practical data structure for indexing text in external storage, and we demonstrate its viability as a strategy to deploy massive DNA databases on memory-constrained devices. Finally, we combine both solutions into Coriolis, a metagenomic classifier designed specifically to operate on lightweight mobile devices. Through experiments with actual MinION metagenomic reads and a portable supercomputer-on-a-chip, we show that compared with the state-of-the-art solutions Coriolis offers higher throughput and lower resource consumption without sacrificing quality of classification. Availability and implementation Source code and test data are available from http://score-group.org/?id=smarten.</description><subject>Algorithms</subject><subject>Bioinformatics of Microbes and Microbiomes</subject><subject>Computers, Handheld</subject><subject>Databases, Nucleic Acid</subject><subject>Metagenome</subject><subject>Metagenomics</subject><issn>1367-4803</issn><issn>1367-4811</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>TOX</sourceid><recordid>eNqNkctOwzAQRS0EolD4hSpLNqV-xgkbhCpeohIbWFu2M0mNnLjESRF_T6qWiu6QRp6RfObO2BehCcHXBOdsZlxwTRnaWnfOxpnpdEE5O0JnhKVyyjNCjvc1ZiN0HuMHxlhgkZ6iEZMsk4TmZ-hlHloXvIs3CTTaeNdUSQ2drqAJtbOJ9TpGVzo7zAlNMoR31bL7gs2Z1ME4D0kBa2chXqCTUvsIl7s8Ru8P92_zp-ni9fF5freYWi5kN01NWgoKpck5zXQBTEiiOWWGmIxLnRZFbrjmxuRlXmDBS2wyMIZIajhnrGBjdLvVXfWmhsJC07Xaq1Xrat1-q6CdOrxp3FJVYa0IZmR4tRgUrnYKbfjsIXaqdtGC97qB0EdFM0aFlAM8oOkWtW2IsYVyP4dgtbFCHVqhdlYMjZO_W-7bfv9-AMgWCP3qv6I_qWWfdg</recordid><startdate>20230630</startdate><enddate>20230630</enddate><creator>Mikalsen, Andrew J</creator><creator>Zola, Jaroslaw</creator><general>Oxford University Press</general><scope>TOX</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope></search><sort><creationdate>20230630</creationdate><title>Coriolis: enabling metagenomic classification on lightweight mobile devices</title><author>Mikalsen, Andrew J ; Zola, Jaroslaw</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Algorithms</topic><topic>Bioinformatics of Microbes and Microbiomes</topic><topic>Computers, Handheld</topic><topic>Databases, Nucleic Acid</topic><topic>Metagenome</topic><topic>Metagenomics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Mikalsen, Andrew J</creatorcontrib><creatorcontrib>Zola, Jaroslaw</creatorcontrib><collection>OUP_牛津大学出版社OA刊</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Bioinformatics (Oxford, England)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mikalsen, Andrew J</au><au>Zola, Jaroslaw</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Coriolis: enabling metagenomic classification on lightweight mobile devices</atitle><jtitle>Bioinformatics (Oxford, England)</jtitle><addtitle>Bioinformatics</addtitle><date>2023-06-30</date><risdate>2023</risdate><volume>39</volume><issue>Supplement_1</issue><spage>i66</spage><epage>i75</epage><pages>i66-i75</pages><issn>1367-4803</issn><eissn>1367-4811</eissn><abstract>Abstract Motivation The introduction of portable DNA sequencers such as the Oxford Nanopore Technologies MinION has enabled real-time and in the field DNA sequencing. However, in the field sequencing is actionable only when coupled with in the field DNA classification. This poses new challenges for metagenomic software since mobile deployments are typically in remote locations with limited network connectivity and without access to capable computing devices. Results We propose new strategies to enable in the field metagenomic classification on mobile devices. We first introduce a programming model for expressing metagenomic classifiers that decomposes the classification process into well-defined and manageable abstractions. The model simplifies resource management in mobile setups and enables rapid prototyping of classification algorithms. Next, we introduce the compact string B-tree, a practical data structure for indexing text in external storage, and we demonstrate its viability as a strategy to deploy massive DNA databases on memory-constrained devices. Finally, we combine both solutions into Coriolis, a metagenomic classifier designed specifically to operate on lightweight mobile devices. Through experiments with actual MinION metagenomic reads and a portable supercomputer-on-a-chip, we show that compared with the state-of-the-art solutions Coriolis offers higher throughput and lower resource consumption without sacrificing quality of classification. Availability and implementation Source code and test data are available from http://score-group.org/?id=smarten.</abstract><cop>England</cop><pub>Oxford University Press</pub><pmid>37387129</pmid><doi>10.1093/bioinformatics/btad243</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1367-4803
ispartof Bioinformatics (Oxford, England), 2023-06, Vol.39 (Supplement_1), p.i66-i75
issn 1367-4803
1367-4811
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10311295
source OUP_牛津大学出版社OA刊; PubMed Central
subjects Algorithms
Bioinformatics of Microbes and Microbiomes
Computers, Handheld
Databases, Nucleic Acid
Metagenome
Metagenomics
title Coriolis: enabling metagenomic classification on lightweight mobile devices
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T04%3A34%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Coriolis:%20enabling%20metagenomic%20classification%20on%20lightweight%20mobile%20devices&rft.jtitle=Bioinformatics%20(Oxford,%20England)&rft.au=Mikalsen,%20Andrew%20J&rft.date=2023-06-30&rft.volume=39&rft.issue=Supplement_1&rft.spage=i66&rft.epage=i75&rft.pages=i66-i75&rft.issn=1367-4803&rft.eissn=1367-4811&rft_id=info:doi/10.1093/bioinformatics/btad243&rft_dat=%3Cproquest_pubme%3E2832577112%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c457t-6b6f52efb9428ade3571a423b1b847a6dd9b4a4bb9f9d054f0b8ebb172b4433d3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2832577112&rft_id=info:pmid/37387129&rft_oup_id=10.1093/bioinformatics/btad243&rfr_iscdi=true