Skip to main content

Serious Games: Augmented Reality in Surgery

The liver planner is a project at TU Graz that provides important components to ARIS*ER. Key elements are vessel segmentation, data models and augmented reality interaction.

Serious Games Equipping Surgeons With Real-time X-ray Vision

Via: Studierstube Augmented Reality Projects

The ARIS*ER challenge is to provide doctors with decision support guidance for patient's treatment, through comprehensive information from multiple sources and visual and haptic feedback.

Guidance is based on several imaging modalities, such as ultrasound, MRI and video-endoscopy. A group of young researchers is being trained to work internationally and multidisciplinary. The team is working across the boarders of medical interventions, information and communication technology development as well as user interface design.

ARIS*ER user centered design

The provided information would be under doctors' control: free angle choice; visual and haptic information, matching human sensory and cognitive strategies and capabilities; easy to use and easy to learn interface. 


Because the work situation is one of high cognitive and physical workload, with high risks when human errors are made, intuitive and easy to learn interfaces are required. New interface design techniques are emerging involving medical end users in system design with the aim to come up with intuitive and error resistant interfaces. Experiences from aviation and process control are used, and are finally brought into the clinical field.

Augmented Reality (AR) is being used as a means of displaying multi-modal image information in an interactive manner. Reliable tools for the application of AR technology in minimally invasive therapy will be developed. This field is relatively new and immature. AR defines a wide spectrum of research topics, having in common 3D graphics techniques previously used in Virtual Reality (VR). AR thus leverages on computer graphics development.

ARIS*ER research and development is centered on clinical applications such as Laparoscopic liver resection, Endoscopic mitral valve repair/replacement and MRI guided RF ablation and the anticipated results are working prototypes, tested in hospitals, and for further product development.