While touch technology has proven its usability for 2D interaction and has already become a standard input modality for many devices, the challenges to exploit its applicability with stereoscopically rendered content have barely been studied. In this project, we utilize different hardware and perception-based techniques to allow users to touch stereoscopically displayed objects when the input is constrained to a 2D surface.
Approaches to handle this problem can roughly be separated into three groups:
- Approaches that separate the interactive and the visualization surfaces, such that the user can move the interactive surface and manipulate an object in-place.
- Approaches that utilize the limitations of the human’s visual system. Here some visual illusion is used, such that the virtual scene is perceived and understood in 3D while the interaction tasks are carried out on a 2D surface.
- Approaches that shift the problem into the interface design space and distinguish 3D touch as separate input modality with its own set of interaction techniques.
We have conducted a series of experiments to investigate the user’s ability to discriminate small induced shifts while performing a touch gesture. Our results indicate that slight object shifts during touch interaction make the virtual scene perceptually more stable, compared to a static scene. Therefore, applications have to manipulate virtual objects to make them appear more static to the user. The results were used to design a practical interaction technique, the "attracting shift technique", that is suitable for numerous application scenarios. Furthermore, we demonstrate how multi-touch hand gestures in combination with foot gestures can be used to perform navigation tasks in interactive 3D environments.
D. Valkov Chapter 9: Multi-Touch for Stereoscopic Displays
A. Giesler, D. Valkov, K. HinrichsVoid shadows: multi-touch interaction with stereoscopic objects on the tabletop
P. Lubos, D. Valkov, The significance of stereopsis and motion parallax in mobile head tracking environments
D. Valkov, A. Giesler, K. Hinrichs, Imperceptible depth shifts for touch interaction with stereoscopic objects
D. Valkov, A. Giesler, K. Hinrichs, Evaluation of depth perception for touch interaction with stereoscopic rendered objects
S. Strothoff, D. Valkov, K. Hinrichs, Triangle cursor: Interactions with objects above the tabletop
D. Valkov, F. Steinicke, G. Bruder, K. Hinrichs, 2D Touching of 3D Stereoscopic Objects
D. Valkov, F. Steinicke, G. Bruder, K. Hinrichs, J. Schöning, F. Daiber, Touching Floating Objects in Projection-based Virtual Reality Environments
J. Schöning, F. Steinicke, A. Krüger, K. Hinrichs, D. Valkov, Bimanual interaction with interscopic multi-touch surfaces