A Survey on Multimodal Medical Data Visualization
Abstract
Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication. Over the years, multiple techniques have been developed in order to cope with the various associated challenges and present the relevant information from multiple sources in an insightful way. We present an overview of these techniques and analyse the specific challenges that arise in multi‐modal data visualization and how recent works aimed to solve these, often using smart visibility techniques. We provide a taxonomy of these multi‐modal visualization applications based on the modalities used and the visualization techniques employed. Additionally, we identify unsolved problems as potential future research directions.Multi‐modal data of the complex human anatomy contain a wealth of information. To visualize and explore such data, techniques for emphasizing important structures and controlling visibility are essential. Such fused overview visualizations guide physicians to suspicious regions to be analysed in detail, e.g. with slice‐based viewing. We give an overview of state of the art in multi‐modal medical data visualization techniques. Multi‐modal medical data consist of multiple scans of the same subject using various acquisition methods, often combining multiple complimentary types of information. Three‐dimensional visualization techniques for multi‐modal medical data can be used in diagnosis, treatment planning, doctor–patient communication as well as interdisciplinary communication.
BibTeX
@article {10.1111:cgf.13306,
journal = {Computer Graphics Forum},
title = {{A Survey on Multimodal Medical Data Visualization}},
author = {Lawonn, K. and Smit, N.N. and Bühler, K. and Preim, B.},
year = {2018},
publisher = {© 2018 The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.13306}
}
journal = {Computer Graphics Forum},
title = {{A Survey on Multimodal Medical Data Visualization}},
author = {Lawonn, K. and Smit, N.N. and Bühler, K. and Preim, B.},
year = {2018},
publisher = {© 2018 The Eurographics Association and John Wiley & Sons Ltd.},
ISSN = {1467-8659},
DOI = {10.1111/cgf.13306}
}
Collections
Related items
Showing items related by title, author, creator and subject.
-
Visualizing for the Non-Visual: Enabling the Visually Impaired to Use Visualization
Choi, Jinho; Jung, Sanghun; Park, Deok Gun; Choo, Jaegul; Elmqvist, Niklas (The Eurographics Association and John Wiley & Sons Ltd., 2019)The majority of visualizations on the web are still stored as raster images, making them inaccessible to visually impaired users. We propose a deep-neural-network-based approach that automatically recognizes key elements ... -
Query by Visual Words: Visual Search for Scatter Plot Visualizations
Shao, Lin; Schleicher, Timo; Schreck, Tobias (The Eurographics Association, 2016)Finding interesting views in large collections of data visualizations, e.g., scatter plots, is challenging. Recently, ranking views based on heuristic quality measures has been proposed. However, quality measures may fail ... -
Steering the Craft: UI Elements and Visualizations for Supporting Progressive Visual Analytics
Badam, Sriram Karthik; Elmqvist, Niklas; Fekete, Jean-Daniel (The Eurographics Association and John Wiley & Sons Ltd., 2017)Progressive visual analytics (PVA) has emerged in recent years to manage the latency of data analysis systems. When analysis is performed progressively, rough estimates of the results are generated quickly and are then ...