Multimodal Augmentation of Haptic Touch Input

July 2nd, 11 AM - 2 PM Eastern Time

Aims and goals

The question of introducing more multimodal haptic feedback into consumer products is becoming crucial today, with the advent of a society increasingly focused on digital solutions. Paradoxically, devices are now accessible to more people, but a segment of the population is  excluded from these digital developments: elderly individuals who struggle to use touch screens, and visually-or auditory-impaired individuals. Indeed, computers and other devices provide information to users almost exclusively through visual and auditory feedback. How information conveyed by the different senses can integrate into a unified multisensory experience has been studied extensively. The brain integrates these inputs to reinforce information, especially when sensory signals become less reliable. Most of the studies on tactile-visual and tactile-auditory integration have been achieved in passive conditions, i.e. in conditions where the sensory inputs are not generated by active finger interactions with the environment. But recent advances in haptic surfaces offer now the possibility to study the cross-modal interaction with regard to body engagement, thus offering new perspectives for integrating multimodal haptic feedback.
The goal of this workshop is to present the state of the art in the field of multimodal touch devices, through a series of talks by experts. We will cover topics tied to Neuroscience, Psychophysics, Human Computer Interaction and Engineering.

Confirmed list of speakers

Time slot
(Easter time)
Name and affiliation of the speaker Title of the presentation
11:00 11:25 Olivier Collignon
Université Catholique de Louvain
Vision shapes how we feel touch in space
11:25 11:50 Monica Gori & Maria Casado Palacio
Istituto Italiano di Tecnologia, Genova,
Visual, audio and haptic integration and interaction
for rehabilitation
11:50 12:10 Eric Vezzoli
Interhaptics & GoTouch VR
Hand visualization and haptics rendering
12:15 12:30 Breaking rooms session  
12:30 12:55 Frédéric Giraud & Betty Semail & Detjon Brahimaj
L2EP, University of Lille
Technological issues with multimodal touch input devices
12:55 1:20 Radu Daniel Vatavu
MintViz, Ștefan cel Mare University of Suceava,
Haptic feedback for gesture interaction
1:20 1:45 Arthur Paté
IEMN Junia Lille
Vibrotactile, audio, and visual augmentation
of an electric guitar: How is it perceived?
1:45 2:00 Breaking rooms session  

This project has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement No 860114