Voice Activation Visualization for Echocardiograph and 3D Angiographic Images in Surgery

Abstract

In some cases, surgeons need to navigate through the computer system for reconfirmation patients’ details and unfortunately surgeons unable to manage both computer system and operation at the same time. In this paper we propose a solution for this problem especially designed for heart surgeon, by introducing voice activation system with 3D visualization of Angiographic images, 2D visualization of Echocardiography processed video and selected patient’s details. In this study, the processing, approximation of the 3D angiography and the visualization of the 2D echocardiography video with voice recognition control are the most challenging work. The work involve with predicting 3D coronary three from 2D angiography image and also image enhancement which utilize the median filtering, morphological opening and contrast improvement and heart boundaries detection. With 3D reconstruction of 2D angiography images, the system was able to display 3D coronary tree, with voice activation. The system was able to rotate, zoom in and out the 3D image, the 2D echocardiography video and display patient’s information that needed by the surgeon while doing heart surgery. Development of this system is useful for surgeons, where they can navigate the system using voice commands instead of keyboard and mouse. Medical practitioners also can facilitate more the angiogram and echocardiograph images. With this system, it can help and ease the work of surgeons in analyzing and processing the medical images especially in-vivo procedure.