ARC Control Tower: A flexible generic distributed job management framework

While current grid middleware implementations are quite advanced in terms of connecting jobs to resources, their client tools are generally quite minimal and features for managing large sets of jobs are left to the user to implement. The ARC Control Tower (aCT) is a very flexible job management fram...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2015-01, Vol.664 (6), p.62042
Main Authors: Nilsen, J.K., Cameron, D., Filip i, A.
Format: Article
Language:English
Subjects:
Middleware
Physics
Redesign
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3
cites cdi_FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3
container_end_page
container_issue 6
container_start_page 62042
container_title Journal of physics. Conference series
container_volume 664
creator Nilsen, J.K.
Cameron, D.
Filip i, A.
description While current grid middleware implementations are quite advanced in terms of connecting jobs to resources, their client tools are generally quite minimal and features for managing large sets of jobs are left to the user to implement. The ARC Control Tower (aCT) is a very flexible job management framework that can be run on anything from a single users laptop to a multi-server distributed setup. aCT was originally designed to enable ATLAS jobs to be submitted to the ARC CE. However, with the recent redesign of aCT where the ATLAS specific elements are clearly separated from the ARC job management parts, the control tower can now easily be reused as a flexible generic distributed job manager for other communities. This paper will give a detailed explanation how aCT works as a job management framework and go through the steps needed to create a simple job manager using aCT and show that it can easily manage thousands of jobs.
doi_str_mv 10.1088/1742-6596/664/6/062042
format article
fullrecord <record><control><sourceid>proquest_iop_j</sourceid><recordid>TN_cdi_proquest_journals_2576453116</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2576453116</sourcerecordid><originalsourceid>FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3</originalsourceid><addsrcrecordid>eNqFkF1LwzAUhoMoOKd_QQJe1-arSerdKH4yEGRehzQfo7NtZtIx_fd2VOal5-YcOO9zDjwAXGN0i5GUORaMZLwoec45y3mOOEGMnIDZcXF6nKU8BxcpbRCiY4kZeFm8VbAK_RBDC1dh7-IdXEDfuq-mbh1cu97FxkDbpCE29W5wFm5CDTvd67XrXD9AH3Xn9iF-XIIzr9vkrn77HLw_3K-qp2z5-vhcLZaZYUQMGa5JYSnxXmhDaSlKYqgx2mrLjCidRhxZw42XWgvNnLeYWW2kH-EaydrQObiZ7m5j-Ny5NKhN2MV-fKlIITgrKMZ8TPEpZWJIKTqvtrHpdPxWGKmDN3VQog561OhNcTV5G0EygU3Y_l3-B_oBow1wIw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2576453116</pqid></control><display><type>article</type><title>ARC Control Tower: A flexible generic distributed job management framework</title><source>Publicly Available Content Database</source><source>Free Full-Text Journals in Chemistry</source><creator>Nilsen, J.K. ; Cameron, D. ; Filip i, A.</creator><creatorcontrib>Nilsen, J.K. ; Cameron, D. ; Filip i, A.</creatorcontrib><description>While current grid middleware implementations are quite advanced in terms of connecting jobs to resources, their client tools are generally quite minimal and features for managing large sets of jobs are left to the user to implement. The ARC Control Tower (aCT) is a very flexible job management framework that can be run on anything from a single users laptop to a multi-server distributed setup. aCT was originally designed to enable ATLAS jobs to be submitted to the ARC CE. However, with the recent redesign of aCT where the ATLAS specific elements are clearly separated from the ARC job management parts, the control tower can now easily be reused as a flexible generic distributed job manager for other communities. This paper will give a detailed explanation how aCT works as a job management framework and go through the steps needed to create a simple job manager using aCT and show that it can easily manage thousands of jobs.</description><identifier>ISSN: 1742-6588</identifier><identifier>EISSN: 1742-6596</identifier><identifier>DOI: 10.1088/1742-6596/664/6/062042</identifier><language>eng</language><publisher>Bristol: IOP Publishing</publisher><subject>Middleware ; Physics ; Redesign</subject><ispartof>Journal of physics. Conference series, 2015-01, Vol.664 (6), p.62042</ispartof><rights>Published under licence by IOP Publishing Ltd</rights><rights>2015. This work is published under http://creativecommons.org/licenses/by/3.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3</citedby><cites>FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.proquest.com/docview/2576453116?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,25753,27924,27925,37012,44590</link.rule.ids></links><search><creatorcontrib>Nilsen, J.K.</creatorcontrib><creatorcontrib>Cameron, D.</creatorcontrib><creatorcontrib>Filip i, A.</creatorcontrib><title>ARC Control Tower: A flexible generic distributed job management framework</title><title>Journal of physics. Conference series</title><addtitle>J. Phys.: Conf. Ser</addtitle><description>While current grid middleware implementations are quite advanced in terms of connecting jobs to resources, their client tools are generally quite minimal and features for managing large sets of jobs are left to the user to implement. The ARC Control Tower (aCT) is a very flexible job management framework that can be run on anything from a single users laptop to a multi-server distributed setup. aCT was originally designed to enable ATLAS jobs to be submitted to the ARC CE. However, with the recent redesign of aCT where the ATLAS specific elements are clearly separated from the ARC job management parts, the control tower can now easily be reused as a flexible generic distributed job manager for other communities. This paper will give a detailed explanation how aCT works as a job management framework and go through the steps needed to create a simple job manager using aCT and show that it can easily manage thousands of jobs.</description><subject>Middleware</subject><subject>Physics</subject><subject>Redesign</subject><issn>1742-6588</issn><issn>1742-6596</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNqFkF1LwzAUhoMoOKd_QQJe1-arSerdKH4yEGRehzQfo7NtZtIx_fd2VOal5-YcOO9zDjwAXGN0i5GUORaMZLwoec45y3mOOEGMnIDZcXF6nKU8BxcpbRCiY4kZeFm8VbAK_RBDC1dh7-IdXEDfuq-mbh1cu97FxkDbpCE29W5wFm5CDTvd67XrXD9AH3Xn9iF-XIIzr9vkrn77HLw_3K-qp2z5-vhcLZaZYUQMGa5JYSnxXmhDaSlKYqgx2mrLjCidRhxZw42XWgvNnLeYWW2kH-EaydrQObiZ7m5j-Ny5NKhN2MV-fKlIITgrKMZ8TPEpZWJIKTqvtrHpdPxWGKmDN3VQog561OhNcTV5G0EygU3Y_l3-B_oBow1wIw</recordid><startdate>20150101</startdate><enddate>20150101</enddate><creator>Nilsen, J.K.</creator><creator>Cameron, D.</creator><creator>Filip i, A.</creator><general>IOP Publishing</general><scope>O3W</scope><scope>TSCCA</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>H8D</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope></search><sort><creationdate>20150101</creationdate><title>ARC Control Tower: A flexible generic distributed job management framework</title><author>Nilsen, J.K. ; Cameron, D. ; Filip i, A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Middleware</topic><topic>Physics</topic><topic>Redesign</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Nilsen, J.K.</creatorcontrib><creatorcontrib>Cameron, D.</creatorcontrib><creatorcontrib>Filip i, A.</creatorcontrib><collection>IOP_英国物理学会OA刊</collection><collection>IOPscience (Open Access)</collection><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Aerospace Database</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>ProQuest advanced technologies &amp; aerospace journals</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Journal of physics. Conference series</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Nilsen, J.K.</au><au>Cameron, D.</au><au>Filip i, A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>ARC Control Tower: A flexible generic distributed job management framework</atitle><jtitle>Journal of physics. Conference series</jtitle><addtitle>J. Phys.: Conf. Ser</addtitle><date>2015-01-01</date><risdate>2015</risdate><volume>664</volume><issue>6</issue><spage>62042</spage><pages>62042-</pages><issn>1742-6588</issn><eissn>1742-6596</eissn><abstract>While current grid middleware implementations are quite advanced in terms of connecting jobs to resources, their client tools are generally quite minimal and features for managing large sets of jobs are left to the user to implement. The ARC Control Tower (aCT) is a very flexible job management framework that can be run on anything from a single users laptop to a multi-server distributed setup. aCT was originally designed to enable ATLAS jobs to be submitted to the ARC CE. However, with the recent redesign of aCT where the ATLAS specific elements are clearly separated from the ARC job management parts, the control tower can now easily be reused as a flexible generic distributed job manager for other communities. This paper will give a detailed explanation how aCT works as a job management framework and go through the steps needed to create a simple job manager using aCT and show that it can easily manage thousands of jobs.</abstract><cop>Bristol</cop><pub>IOP Publishing</pub><doi>10.1088/1742-6596/664/6/062042</doi><tpages>8</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1742-6588
ispartof Journal of physics. Conference series, 2015-01, Vol.664 (6), p.62042
issn 1742-6588
1742-6596
language eng
recordid cdi_proquest_journals_2576453116
source Publicly Available Content Database; Free Full-Text Journals in Chemistry
subjects Middleware
Physics
Redesign
title ARC Control Tower: A flexible generic distributed job management framework
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T07%3A38%3A43IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_iop_j&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=ARC%20Control%20Tower:%20A%20flexible%20generic%20distributed%20job%20management%20framework&rft.jtitle=Journal%20of%20physics.%20Conference%20series&rft.au=Nilsen,%20J.K.&rft.date=2015-01-01&rft.volume=664&rft.issue=6&rft.spage=62042&rft.pages=62042-&rft.issn=1742-6588&rft.eissn=1742-6596&rft_id=info:doi/10.1088/1742-6596/664/6/062042&rft_dat=%3Cproquest_iop_j%3E2576453116%3C/proquest_iop_j%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c427t-1b25d32ff7ac339792c3ccadad4c79ea060dc6cf8aa7a4efd14dac8f427b08bc3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2576453116&rft_id=info:pmid/&rfr_iscdi=true