A Peer-to-Peer Architecture for Supporting Dynamic Shared Libraries in Large-Scale Systems

Historically, scientific computing applications have been statically linked before running on massively parallel High Performance Computing (HPC) platforms. In recent years, demand for supporting dynamically linked applications at large scale has increased. When programs running at large scale dynam...

Full description

Saved in:
Bibliographic Details
Main Authors: Dosanjh, M. G. F., Bridges, P. G., Kelly, S. M., Laros, J. H.
Format: Conference Proceeding
Language:English
Subjects:
DSL
File systems
Fuses
High performance computing
Libraries
Optimization
Parallel programming
Peer to peer computing
Protocols
Runtime
System software
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page 61
container_issue
container_start_page 55
container_title
container_volume
creator Dosanjh, M. G. F.
Bridges, P. G.
Kelly, S. M.
Laros, J. H.
description Historically, scientific computing applications have been statically linked before running on massively parallel High Performance Computing (HPC) platforms. In recent years, demand for supporting dynamically linked applications at large scale has increased. When programs running at large scale dynamically load shared objects, they often request the same file from shared storage. These independent requests tax the shared storage and the network, causing a significant delay in computation time. In this paper, we propose to leverage a proven file sharing technique, Bit Torrent, abstracted by an on-node FUSE interface to create a system-level distribution method for these files. We detail our proposed methodology, related work, and our current progress.
doi_str_mv 10.1109/ICPPW.2012.11
format conference_proceeding
fullrecord <record><control><sourceid>ieee_6IE</sourceid><recordid>TN_cdi_ieee_primary_6337463</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6337463</ieee_id><sourcerecordid>6337463</sourcerecordid><originalsourceid>FETCH-LOGICAL-i90t-e8e11ed461f3a6b96d9b7442ce695cbe18c2615fd23505689841a36dfe95483a3</originalsourceid><addsrcrecordid>eNotT8lqwzAUVDdoSH3sqRf9gFI9SdZyDOkWMNTgQKGXIMvPiUqcBNk55O_rLgMzwzAwMITcA58BcPe4XJTlx0xwEGO-IJkzlhvtcmVGXpKJkFKwXDt-9duB0kaKnDtzTSYcHGfSgb0lWd9_8RFWgLQwIZ9zWiImNhzYj9N5Cts4YBhOCWl7SLQ6HY-HNMT9hj6d976LgVZbn7ChRayTTxF7Gve08GmDrAp-h7Q69wN2_R25af2ux-zfp2T18rxavLHi_XW5mBcsOj4wtAiAjdLQSq9rpxtXG6VEwPFcqBFsEBrythEy57m2zirwUjctjr-t9HJKHv5mIyKujyl2Pp3XWkqjRvkGwnRWXA</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>A Peer-to-Peer Architecture for Supporting Dynamic Shared Libraries in Large-Scale Systems</title><source>IEEE Electronic Library (IEL) Conference Proceedings</source><creator>Dosanjh, M. G. F. ; Bridges, P. G. ; Kelly, S. M. ; Laros, J. H.</creator><creatorcontrib>Dosanjh, M. G. F. ; Bridges, P. G. ; Kelly, S. M. ; Laros, J. H.</creatorcontrib><description>Historically, scientific computing applications have been statically linked before running on massively parallel High Performance Computing (HPC) platforms. In recent years, demand for supporting dynamically linked applications at large scale has increased. When programs running at large scale dynamically load shared objects, they often request the same file from shared storage. These independent requests tax the shared storage and the network, causing a significant delay in computation time. In this paper, we propose to leverage a proven file sharing technique, Bit Torrent, abstracted by an on-node FUSE interface to create a system-level distribution method for these files. We detail our proposed methodology, related work, and our current progress.</description><identifier>ISSN: 0190-3918</identifier><identifier>ISBN: 9781467325097</identifier><identifier>ISBN: 1467325090</identifier><identifier>EISSN: 2332-5690</identifier><identifier>EISBN: 9780769547954</identifier><identifier>EISBN: 0769547958</identifier><identifier>DOI: 10.1109/ICPPW.2012.11</identifier><identifier>CODEN: IEEPAD</identifier><language>eng</language><publisher>IEEE</publisher><subject>DSL ; File systems ; Fuses ; High performance computing ; Libraries ; Optimization ; Parallel programming ; Peer to peer computing ; Protocols ; Runtime ; System software</subject><ispartof>2012 41st International Conference on Parallel Processing Workshops, 2012, p.55-61</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6337463$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,2058,27925,54920</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/6337463$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Dosanjh, M. G. F.</creatorcontrib><creatorcontrib>Bridges, P. G.</creatorcontrib><creatorcontrib>Kelly, S. M.</creatorcontrib><creatorcontrib>Laros, J. H.</creatorcontrib><title>A Peer-to-Peer Architecture for Supporting Dynamic Shared Libraries in Large-Scale Systems</title><title>2012 41st International Conference on Parallel Processing Workshops</title><addtitle>icppw</addtitle><description>Historically, scientific computing applications have been statically linked before running on massively parallel High Performance Computing (HPC) platforms. In recent years, demand for supporting dynamically linked applications at large scale has increased. When programs running at large scale dynamically load shared objects, they often request the same file from shared storage. These independent requests tax the shared storage and the network, causing a significant delay in computation time. In this paper, we propose to leverage a proven file sharing technique, Bit Torrent, abstracted by an on-node FUSE interface to create a system-level distribution method for these files. We detail our proposed methodology, related work, and our current progress.</description><subject>DSL</subject><subject>File systems</subject><subject>Fuses</subject><subject>High performance computing</subject><subject>Libraries</subject><subject>Optimization</subject><subject>Parallel programming</subject><subject>Peer to peer computing</subject><subject>Protocols</subject><subject>Runtime</subject><subject>System software</subject><issn>0190-3918</issn><issn>2332-5690</issn><isbn>9781467325097</isbn><isbn>1467325090</isbn><isbn>9780769547954</isbn><isbn>0769547958</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2012</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><recordid>eNotT8lqwzAUVDdoSH3sqRf9gFI9SdZyDOkWMNTgQKGXIMvPiUqcBNk55O_rLgMzwzAwMITcA58BcPe4XJTlx0xwEGO-IJkzlhvtcmVGXpKJkFKwXDt-9duB0kaKnDtzTSYcHGfSgb0lWd9_8RFWgLQwIZ9zWiImNhzYj9N5Cts4YBhOCWl7SLQ6HY-HNMT9hj6d976LgVZbn7ChRayTTxF7Gve08GmDrAp-h7Q69wN2_R25af2ux-zfp2T18rxavLHi_XW5mBcsOj4wtAiAjdLQSq9rpxtXG6VEwPFcqBFsEBrythEy57m2zirwUjctjr-t9HJKHv5mIyKujyl2Pp3XWkqjRvkGwnRWXA</recordid><startdate>201209</startdate><enddate>201209</enddate><creator>Dosanjh, M. G. F.</creator><creator>Bridges, P. G.</creator><creator>Kelly, S. M.</creator><creator>Laros, J. H.</creator><general>IEEE</general><scope>6IE</scope><scope>6IL</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIL</scope></search><sort><creationdate>201209</creationdate><title>A Peer-to-Peer Architecture for Supporting Dynamic Shared Libraries in Large-Scale Systems</title><author>Dosanjh, M. G. F. ; Bridges, P. G. ; Kelly, S. M. ; Laros, J. H.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i90t-e8e11ed461f3a6b96d9b7442ce695cbe18c2615fd23505689841a36dfe95483a3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2012</creationdate><topic>DSL</topic><topic>File systems</topic><topic>Fuses</topic><topic>High performance computing</topic><topic>Libraries</topic><topic>Optimization</topic><topic>Parallel programming</topic><topic>Peer to peer computing</topic><topic>Protocols</topic><topic>Runtime</topic><topic>System software</topic><toplevel>online_resources</toplevel><creatorcontrib>Dosanjh, M. G. F.</creatorcontrib><creatorcontrib>Bridges, P. G.</creatorcontrib><creatorcontrib>Kelly, S. M.</creatorcontrib><creatorcontrib>Laros, J. H.</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP All) 1998-Present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Dosanjh, M. G. F.</au><au>Bridges, P. G.</au><au>Kelly, S. M.</au><au>Laros, J. H.</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>A Peer-to-Peer Architecture for Supporting Dynamic Shared Libraries in Large-Scale Systems</atitle><btitle>2012 41st International Conference on Parallel Processing Workshops</btitle><stitle>icppw</stitle><date>2012-09</date><risdate>2012</risdate><spage>55</spage><epage>61</epage><pages>55-61</pages><issn>0190-3918</issn><eissn>2332-5690</eissn><isbn>9781467325097</isbn><isbn>1467325090</isbn><eisbn>9780769547954</eisbn><eisbn>0769547958</eisbn><coden>IEEPAD</coden><abstract>Historically, scientific computing applications have been statically linked before running on massively parallel High Performance Computing (HPC) platforms. In recent years, demand for supporting dynamically linked applications at large scale has increased. When programs running at large scale dynamically load shared objects, they often request the same file from shared storage. These independent requests tax the shared storage and the network, causing a significant delay in computation time. In this paper, we propose to leverage a proven file sharing technique, Bit Torrent, abstracted by an on-node FUSE interface to create a system-level distribution method for these files. We detail our proposed methodology, related work, and our current progress.</abstract><pub>IEEE</pub><doi>10.1109/ICPPW.2012.11</doi><tpages>7</tpages></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 0190-3918
ispartof 2012 41st International Conference on Parallel Processing Workshops, 2012, p.55-61
issn 0190-3918
2332-5690
language eng
recordid cdi_ieee_primary_6337463
source IEEE Electronic Library (IEL) Conference Proceedings
subjects DSL
File systems
Fuses
High performance computing
Libraries
Optimization
Parallel programming
Peer to peer computing
Protocols
Runtime
System software
title A Peer-to-Peer Architecture for Supporting Dynamic Shared Libraries in Large-Scale Systems
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-01T00%3A25%3A09IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_6IE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=A%20Peer-to-Peer%20Architecture%20for%20Supporting%20Dynamic%20Shared%20Libraries%20in%20Large-Scale%20Systems&rft.btitle=2012%2041st%20International%20Conference%20on%20Parallel%20Processing%20Workshops&rft.au=Dosanjh,%20M.%20G.%20F.&rft.date=2012-09&rft.spage=55&rft.epage=61&rft.pages=55-61&rft.issn=0190-3918&rft.eissn=2332-5690&rft.isbn=9781467325097&rft.isbn_list=1467325090&rft.coden=IEEPAD&rft_id=info:doi/10.1109/ICPPW.2012.11&rft.eisbn=9780769547954&rft.eisbn_list=0769547958&rft_dat=%3Cieee_6IE%3E6337463%3C/ieee_6IE%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-i90t-e8e11ed461f3a6b96d9b7442ce695cbe18c2615fd23505689841a36dfe95483a3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=6337463&rfr_iscdi=true