Direct touch haptic display using immersive illusion with interactive virtual finger

In attempt to improve haptic interaction and manipulation technique in surface computers, we propose an interactive haptic feedback display that utilizes 'direct touch' on a surface computer without using a mediation device. The proposed haptic display lets users interact with the virtual objects inside a pressure-sensitive screen directly using a virtual finger as if the user's finger can penetrate through the screen surface and sink in to the digital world inside the screen, as well as receive haptic feedback direct to their fingers from the display. Using the proposed display, users were able to perceive touch sensation with haptic feedback when they come in contact with virtual object surfaces and discriminate different stiffness using vibratory and pseudo-haptic feedback respectively. This innovation creates a new breakthrough in virtual interaction with more accessible and realistic haptic interaction approach for surface computing.