A Framework for the Evaluation of Trainee Performance in Cyber Range Exercises

This paper proposes a novel approach for the evaluation of the performance achieved by trainees involved in cyber security exercises implemented in modern cyber ranges. Our main contributions include: the definition of a distributed monitoring architecture for gathering relevant information about tr...

Full description

Saved in:
Bibliographic Details
Published in:Mobile networks and applications 2020-02, Vol.25 (1), p.236-247
Main Authors: Andreolini, Mauro, Colacino, Vincenzo Giuseppe, Colajanni, Michele, Marchetti, Mirco
Format: Article
Language:English
Subjects:
Algorithms
Communications Engineering
Computer Communication Networks
Cybersecurity
Electrical Engineering
Engineering
Graph theory
IT in Business
Networks
Performance evaluation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483
cites cdi_FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483
container_end_page 247
container_issue 1
container_start_page 236
container_title Mobile networks and applications
container_volume 25
creator Andreolini, Mauro
Colacino, Vincenzo Giuseppe
Colajanni, Michele
Marchetti, Mirco
description This paper proposes a novel approach for the evaluation of the performance achieved by trainees involved in cyber security exercises implemented in modern cyber ranges. Our main contributions include: the definition of a distributed monitoring architecture for gathering relevant information about trainees activities; an algorithm for modeling the trainee activities using directed graphs; novel scoring algorithms, based on graph operations, that evaluate different aspects (speed, precision) of a trainee during an exercise. With respect to previous work, our proposal allows to measure exactly how fast a user is progressing towards an objective and where he does wrong. We highlight that this is currently not possible in the most popular cyber ranges.
doi_str_mv 10.1007/s11036-019-01442-0
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2355483353</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2355483353</sourcerecordid><originalsourceid>FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483</originalsourceid><addsrcrecordid>eNp9kMFKAzEURYMoWKs_4CrgOprMS6Yzy1JaKxQVqeAuZDIvOrWd1GSq9u-NjuBOQkgW59zHu4ScC34pOB9dRSE45IyLMl0pM8YPyECoUcYKoeAw_aEAJvPy6ZicxLjinCtVyAG5HdNZMBv88OGVOh9o94J0-m7WO9M1vqXe0WUwTYtI7zEkYGNai7Rp6WRfYaAPpn1OwicG20SMp-TImXXEs993SB5n0-VkzhZ31zeT8YJZyKFjaEGovHJQpoN1Vlhha-FMUcmicq62AHKUozKqdGVd10IqACdEVqkKEwNDctHnboN_22Hs9MrvQptG6gyUSgQkY0iynrLBxxjQ6W1oNibsteD6uzfd96ZTb_qnN82TBL0UE5yWC3_R_1hfsp5wGw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2355483353</pqid></control><display><type>article</type><title>A Framework for the Evaluation of Trainee Performance in Cyber Range Exercises</title><source>ABI/INFORM Global</source><source>Springer Nature</source><creator>Andreolini, Mauro ; Colacino, Vincenzo Giuseppe ; Colajanni, Michele ; Marchetti, Mirco</creator><creatorcontrib>Andreolini, Mauro ; Colacino, Vincenzo Giuseppe ; Colajanni, Michele ; Marchetti, Mirco</creatorcontrib><description>This paper proposes a novel approach for the evaluation of the performance achieved by trainees involved in cyber security exercises implemented in modern cyber ranges. Our main contributions include: the definition of a distributed monitoring architecture for gathering relevant information about trainees activities; an algorithm for modeling the trainee activities using directed graphs; novel scoring algorithms, based on graph operations, that evaluate different aspects (speed, precision) of a trainee during an exercise. With respect to previous work, our proposal allows to measure exactly how fast a user is progressing towards an objective and where he does wrong. We highlight that this is currently not possible in the most popular cyber ranges.</description><identifier>ISSN: 1383-469X</identifier><identifier>EISSN: 1572-8153</identifier><identifier>DOI: 10.1007/s11036-019-01442-0</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Algorithms ; Communications Engineering ; Computer Communication Networks ; Cybersecurity ; Electrical Engineering ; Engineering ; Graph theory ; IT in Business ; Networks ; Performance evaluation</subject><ispartof>Mobile networks and applications, 2020-02, Vol.25 (1), p.236-247</ispartof><rights>Springer Science+Business Media, LLC, part of Springer Nature 2019</rights><rights>Mobile Networks and Applications is a copyright of Springer, (2019). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483</citedby><cites>FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2355483353/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2355483353?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,780,784,11688,27924,27925,36060,44363,74895</link.rule.ids></links><search><creatorcontrib>Andreolini, Mauro</creatorcontrib><creatorcontrib>Colacino, Vincenzo Giuseppe</creatorcontrib><creatorcontrib>Colajanni, Michele</creatorcontrib><creatorcontrib>Marchetti, Mirco</creatorcontrib><title>A Framework for the Evaluation of Trainee Performance in Cyber Range Exercises</title><title>Mobile networks and applications</title><addtitle>Mobile Netw Appl</addtitle><description>This paper proposes a novel approach for the evaluation of the performance achieved by trainees involved in cyber security exercises implemented in modern cyber ranges. Our main contributions include: the definition of a distributed monitoring architecture for gathering relevant information about trainees activities; an algorithm for modeling the trainee activities using directed graphs; novel scoring algorithms, based on graph operations, that evaluate different aspects (speed, precision) of a trainee during an exercise. With respect to previous work, our proposal allows to measure exactly how fast a user is progressing towards an objective and where he does wrong. We highlight that this is currently not possible in the most popular cyber ranges.</description><subject>Algorithms</subject><subject>Communications Engineering</subject><subject>Computer Communication Networks</subject><subject>Cybersecurity</subject><subject>Electrical Engineering</subject><subject>Engineering</subject><subject>Graph theory</subject><subject>IT in Business</subject><subject>Networks</subject><subject>Performance evaluation</subject><issn>1383-469X</issn><issn>1572-8153</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>M0C</sourceid><recordid>eNp9kMFKAzEURYMoWKs_4CrgOprMS6Yzy1JaKxQVqeAuZDIvOrWd1GSq9u-NjuBOQkgW59zHu4ScC34pOB9dRSE45IyLMl0pM8YPyECoUcYKoeAw_aEAJvPy6ZicxLjinCtVyAG5HdNZMBv88OGVOh9o94J0-m7WO9M1vqXe0WUwTYtI7zEkYGNai7Rp6WRfYaAPpn1OwicG20SMp-TImXXEs993SB5n0-VkzhZ31zeT8YJZyKFjaEGovHJQpoN1Vlhha-FMUcmicq62AHKUozKqdGVd10IqACdEVqkKEwNDctHnboN_22Hs9MrvQptG6gyUSgQkY0iynrLBxxjQ6W1oNibsteD6uzfd96ZTb_qnN82TBL0UE5yWC3_R_1hfsp5wGw</recordid><startdate>20200201</startdate><enddate>20200201</enddate><creator>Andreolini, Mauro</creator><creator>Colacino, Vincenzo Giuseppe</creator><creator>Colajanni, Michele</creator><creator>Marchetti, Mirco</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7SP</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>Q9U</scope></search><sort><creationdate>20200201</creationdate><title>A Framework for the Evaluation of Trainee Performance in Cyber Range Exercises</title><author>Andreolini, Mauro ; Colacino, Vincenzo Giuseppe ; Colajanni, Michele ; Marchetti, Mirco</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Communications Engineering</topic><topic>Computer Communication Networks</topic><topic>Cybersecurity</topic><topic>Electrical Engineering</topic><topic>Engineering</topic><topic>Graph theory</topic><topic>IT in Business</topic><topic>Networks</topic><topic>Performance evaluation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Andreolini, Mauro</creatorcontrib><creatorcontrib>Colacino, Vincenzo Giuseppe</creatorcontrib><creatorcontrib>Colajanni, Michele</creatorcontrib><creatorcontrib>Marchetti, Mirco</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Database‎ (1962 - current)</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest Central Basic</collection><jtitle>Mobile networks and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Andreolini, Mauro</au><au>Colacino, Vincenzo Giuseppe</au><au>Colajanni, Michele</au><au>Marchetti, Mirco</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Framework for the Evaluation of Trainee Performance in Cyber Range Exercises</atitle><jtitle>Mobile networks and applications</jtitle><stitle>Mobile Netw Appl</stitle><date>2020-02-01</date><risdate>2020</risdate><volume>25</volume><issue>1</issue><spage>236</spage><epage>247</epage><pages>236-247</pages><issn>1383-469X</issn><eissn>1572-8153</eissn><abstract>This paper proposes a novel approach for the evaluation of the performance achieved by trainees involved in cyber security exercises implemented in modern cyber ranges. Our main contributions include: the definition of a distributed monitoring architecture for gathering relevant information about trainees activities; an algorithm for modeling the trainee activities using directed graphs; novel scoring algorithms, based on graph operations, that evaluate different aspects (speed, precision) of a trainee during an exercise. With respect to previous work, our proposal allows to measure exactly how fast a user is progressing towards an objective and where he does wrong. We highlight that this is currently not possible in the most popular cyber ranges.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11036-019-01442-0</doi><tpages>12</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1383-469X
ispartof Mobile networks and applications, 2020-02, Vol.25 (1), p.236-247
issn 1383-469X
1572-8153
language eng
recordid cdi_proquest_journals_2355483353
source ABI/INFORM Global; Springer Nature
subjects Algorithms
Communications Engineering
Computer Communication Networks
Cybersecurity
Electrical Engineering
Engineering
Graph theory
IT in Business
Networks
Performance evaluation
title A Framework for the Evaluation of Trainee Performance in Cyber Range Exercises
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T19%3A14%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Framework%20for%20the%20Evaluation%20of%20Trainee%20Performance%20in%20Cyber%20Range%20Exercises&rft.jtitle=Mobile%20networks%20and%20applications&rft.au=Andreolini,%20Mauro&rft.date=2020-02-01&rft.volume=25&rft.issue=1&rft.spage=236&rft.epage=247&rft.pages=236-247&rft.issn=1383-469X&rft.eissn=1572-8153&rft_id=info:doi/10.1007/s11036-019-01442-0&rft_dat=%3Cproquest_cross%3E2355483353%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c363t-ec3156bf39393ed28c1cd1fa8b48bffdc33476e5a59f9ddd14533f112b5beb483%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2355483353&rft_id=info:pmid/&rfr_iscdi=true