Virtual reality in advanced medical immersive imaging: a workflow for introducing virtual reality as a supporting tool in medical imaging

• Published in: Computing and visualization in science 2018-03, Vol.18 (6), p.203-212
• Main Authors: Knodel, Markus M., Lemke, Babett, Lampe, Michael, Hoffer, Michael, Gillmann, Clarissa, Uder, Michael, Hillengaß, Jens, Wittum, Gabriel, Bäuerle, Tobias
• Format: Article
• Language: English
• Subjects: Algorithms; Calculus of Variations and Optimal Control; Optimization; Complexity; Computational Mathematics and Numerical Analysis; Computed tomography; Computer Applications in Chemistry; Computer simulation; Diagnostic systems; Magnetic resonance imaging; Mathematical analysis; Mathematics; Mathematics and Statistics; Medical imaging; Numerical Analysis; Original Article; Pathogenesis; Surgical instruments; Virtual environments; Virtual reality; Visual observation; Visualization; Workflow
• ISSN: 1432-9360; 1433-0369
• DOI: 10.1007/s00791-018-0292-3

Radiologic evaluation of images from computed tomography (CT) or magnetic resonance imaging for diagnostic purposes is based on the analysis of single slices, occasionally supplementing this information with 3D reconstructions as well as surface or volume rendered images. However, due to the complexity of anatomical or pathological structures in biomedical imaging, innovative visualization techniques are required to display morphological characteristics three dimensionally. Virtual reality is a modern tool of representing visual data, The observer has the impression of being “inside” a virtual surrounding, which is referred to as immersive imaging. Such techniques are currently being used in technical applications, e.g. in the automobile industry. Our aim is to introduce a workflow realized within one simple program which processes common image stacks from CT, produces 3D volume and surface reconstruction and rendering, and finally includes the data into a virtual reality device equipped with a motion head tracking cave automatic virtual environment system. Such techniques have the potential to augment the possibilities in non-invasive medical imaging, e.g. for surgical planning or educational purposes to add another dimension for advanced understanding of complex anatomical and pathological structures. To this end, the reconstructions are based on advanced mathematical techniques and the corresponding grids which we can export are intended to form the basis for simulations of mathematical models of the pathogenesis of different diseases.