Dual Surgical Navigation Using Augmented and Virtual Environment Techniques

Abstract

To obtain additional depth and visual information in endoscopic surgery, a dual surgical navigation system using virtual reality (VR) and augmented reality (AR) techniques complementarily was developed. A VR environment was constructed in the default 3-D view of the navigation software and an AR environment was developed as a plug-in module. The spatial relationships among the target organ, endoscope, and surgical tools were visualized, and the visual information superimposing invisible organs on the endoscopic images was supplied using the AR environment. Phantom experiments and preliminary clinical application showed promising results for surgical navigation. © Taylor & Francis Group, LLC.