Multimodal interaction in Virtual Reality

Virtual reality has seen a rapid development in the last couple of years, thanks to improvements in hardware and software technologies. Virtual reality research and development has mostly focused on visual feedback. However, virtual reality shown be considered as a  rich multimodal experience, where the representation  and interaction between the different sensorial modalities play an important role.

The  goal of this white paper is to review the state of the art and future directions of the field of virtual reality. We examine the role of multisensory (merely non visual) feedback, and present different research in the field of interface design and cognitive psychology and multimodal perception and cognition that can benefit virtual reality. 

Project participants:

Headroom
Unity technologies
Jabra (GN Netcom A/S)
Oticon
Absolute Zero
Kanda
Molamil
Liquid media
Awe
DTU 

For more information, contact Project Leader:
Professor Stefania Serafin
AAU
sts@create.aau.dk