Singapore, 21st October 2022 h 16-19 GMT+8 (10-13 CEST)

Augmented and Virtual Reality systems are designed to immerse humans into rich and compelling simulated environments by leveraging our perceptual systems (i.e. vision, touch, sound). In turn, exposure to AR/VR can reshape and alter our perceptual processing by tapping into the brain’s significant ability to adapt to changes in the environment through neural plasticity. Therefore, to design successful AR/VR systems, we must first understand the functioning and limitations of our perceptual and cognitive systems. We can then tailor AR/VR technology to optimally stimulate our senses and maximize user experience. Understanding how to wield AR/VR tools to reshape how we perceive the world also has incredible potential for societal and clinical applications.
Intelligently developed AR/VR systems could for example guide the user’s attention to relevant information, which could be useful for helping students learn challenging knowledge in school. AR/VR systems that leverage neuroplasticity could help rehabilitate neurological disorders such as amblyopia or traumatic brain injury. By attending this tutorial, ISMAR attendees will learn how to employ our current understanding of human
perception to design more sophisticated and ecological AR/VR systems that optimize user experience and minimize or even eliminate the undesired side effects of such systems (such as nausea and disorientation due to VR sickness). Additionally, AR/VR researchers attending this tutorial will learn how to exploit the brain’s neuroplasticity to reshape users’ conscious experiences in virtual environments. This knowledge could help evolve AR/VR systems from simple entertainment devices into tools to reshape human perception and behavior. From the classroom to the clinic, from entertainment to rehabilitation, the applications of such tools hold the potential for widespread societal impact.

This tutorial has been taught at ISMAR2018, ISMAR2020 and ISMAR2021 with extremely positive feedback from the public.

16.00 - 16.10 Welcome and Introduction

16.10 - 16.50 Manuela Chessa - Interaction in Virtual, Augmented and Mixed Reality

16.50 - 17.30 Fabio Solari - Computational Models for Natural Perception in Virtual and Augmented Reality

17.30 - 18.10 Dimitri Ognibene - Adaptive Vision for Human Robot Collaboration

18.10 - 18.50 Guido Maiello - Understanding the link between our eyes and hands in the real world to design
better virtual worlds

18.50 - 19.00 Discussion and greetings