Streaming and Data Enrichment

Abstract

Data is being created at a continuously increasing rate. Scientists are drowning in their data . So much so they cannot visualize the data to see the big picture. This work-in-progress paper describes a data capture and visualization problem, and the steps being undertaken to solve the problem. An overview is given of the various approaches to dealing with these large data sets that have been previously proposed and the application of such methods within a well known scientific visualization tool. The paper then goes on to propose a method that deals with large data visualization by addressing the bottlenecks in the visualization pipeline, and combining some of the approaches described herein with parallel techniques on a high performance visualization system.