INTERACTIVE MULTI-MODAL VISUALIZATION ENVIRONMENT FOR COMPLEX SYSTEM DECISION MAKING

摘要

Decision making in a complex system requires a large amount of data, and real time interaction and visualization tools become effective solutions. Constant improvement in computer graphics technology has encouraged the research of developing better and more efficient ways of interacting and visualizing complex three-dimensional image data. This paper presents a unique software framework for interacting and visualizing complex volume image data in a virtual environment. For efficient user interactions, a wireless gamepad controller is used as the main input device. The buttons and joysticks on the gamepad controller are intuitively mapped to perform different functions depending on the feature mode that the software is currently in. Apart from the general viewer, an extension of the software also reads in standard format patient medical images such as CT/MRI scans. As an effective decision making tool, the software allows the user to apply fast pseudo-coloring and multiple interactive oblique clipping planes for an immersive detailed examination of any 3D model. In the medical imaging extension of this software, it features the ability for the user to select a specific range of tissue densities to render and an endo-surgery planning mode that allows a surgeon to place simulated laparoscopic surgical instruments in a virtual model of the patient. The developed software allows for better interaction with complex volume data for use as a decision making and evaluation tool.