A realist evaluation of student use of a virtual reality smartphone application in undergraduate legal education

• Published in: British journal of educational technology 2020-03, Vol.51 (2), p.572-589
• Main Authors: McFaul, Hugh, FitzGerald, Elizabeth
• Format: Article
• Language: English
• Subjects: Computer Simulation; Computer Software; Data analysis; Distance Education; Distance learning; Education; Educational Technology; Empirical analysis; Evaluation; Experiential Learning; Handheld Devices; Instructional Innovation; Intervention; Learner Engagement; Legal Education (Professions); Methodology; Pilot Projects; Skills; Smartphones; Student Attitudes; Students; Teaching Methods; Technology assessment; Telecommunications; Undergraduate Students; Virtual reality
• ISSN: 0007-1013; 1467-8535
• DOI: 10.1111/bjet.12850

This paper provides a realist evaluation of the Open Justice virtual reality (VR) smartphone app, designed to develop presentation skills for students on an undergraduate legal education module. This work addresses two research questions: what proportion of students engaged with the Open Justice app, and what worked for whom in what circumstances and why? Questionnaire and interviews were conducted and analysed using a realist evaluation approach. This approach is particularly pertinent to the evaluation of how emerging educational technologies are used, as it can point to the potential affordances of a technological intervention, in addition to assessing its current use. In keeping with the realist evaluation approach, data analysis was completed using the context–mechanism–outcome framework. The findings suggest that more than half of students did not engage with the app during their studies, but this was not surprising as it was a pilot project into using VR with our students and such innovations can be difficult to manage in distance education contexts. Those who did engage with it recognised the potential of immersive VR to contribute to legal skills development, but they found the application of the technology, in this context, to be of limited use. By utilising a realist evaluation framework, this study contributes to the emerging field of programme theory‐based evaluations of educational technology, which might form the basis of further research. Practitioner Notes What is already known about this topic Smartphone‐based virtual reality technology has developed exponentially and is now widely and cheaply available. Smartphone‐based virtual reality technology has the potential to develop professional skills, and thereby provide a useful addition to experiential learning pedagogies. This is of particular relevance to the development of professional legal skills in the context of clinical legal education. Realist evaluation methodology is increasingly common in health literature to evaluate the impact of education programmes. What this paper adds This is the first empirical study of the use of VR technology to develop professional skills in a distance learning setting. This is the first paper to use realist methodology to evaluate virtual reality technology in legal education. It provides a granular analysis of particular contexts and user responses that can facilitate or inhibit learner engagement with VR technology. Implications for practice and/or p