Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces

3DTouchInteractionWeb350  3DTouchInteractionWeb350-2


We present the design and evaluation of FI3D, a direct-touch data exploration technique for 3D visualization spaces. The exploration of three-dimensional data is core to many tasks and domains involving scientific visualizations. Thus, effective data navigation techniques are essential to enable comprehension, understanding, and analysis of the information space. While evidence exists that touch can provide higher-bandwidth input, somesthetic information that is valuable when interacting with virtual worlds, and awareness when working in collaboration, scientific data exploration in 3D poses unique challenges to the development of effective data manipulations. We present a technique that provides touch interaction with 3D scientific data spaces in 7 DOF. This interaction does not require the presence of dedicated objects to constrain the mapping, a design decision important for many scientific datasets such as particle simulations in astronomy or physics. We report on an evaluation that compares the technique to conventional mouse-based interaction. Our results show that touch interaction is competitive in interaction speed for translation and integrated interaction, is easy to learn and use, and is preferred for exploration and wayfinding tasks. To further explore the applicability of our basic technique for other types of scientific visualizations we present a second case study, adjusting the interaction to the illustrative visualization of fiber tracts of the brain and the manipulation of cutting planes in this context.

Paper download:

You can download the paper from PDF.


We provide a demo of the FI3D technique applied to the astronomical data: for touch surface with Smart DViT hardware (for Win32, 10.3MB) and for touch surface with TUIO input (for Win32, 9.5MB). Both demos also provides a two-mouse emulation.


Get the video:
download the video (AVI-MPEG4, 16.0MB),
watch the video at YouTube

Fast-Forward at VisWeek 2010:

Get the fast-forward video:
download the video (AVI-MPEG4, 3.9MB),
watch the video at YouTube

Poster presented at ITS 2009:


Main Reference:

L. Yu, P. Svetachov, P. Isenberg, M. H. Everts, and T. Isenberg. “FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces”. In: IEEE Transactions on Visualization and Computer Graphics 16.6 (2010), pp. 1613– 1622. (doi) (PDF, 10 pages, 8.32 MB)

Other References:

Lingyun Yu and Tobias Isenberg (2009) Exploring One- and Two-Touch Interaction for 3D Scientific Visualization Spaces. In Mark Ashdown and Mark Hancock, eds., Posters of Interactive Tabletops and Surfaces (ITS 2009, November 23–25, 2009, Banff, Alberta, Canada). 2009.Extended abstract and poster. (Abstract) (Poster) (Video)

Lingyun Yu and Tobias Isenberg (2009) Interactive Visualization of Cosmological Simulations. In SIREN: Scientific ICT Research Event Netherlands (November 5, 2009, University of Twente, The Netherlands). 2009. Poster. (Poster) (Video)