Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations

Journal Title: Informatics - Year 2018, Vol 5, Issue 4

Abstract

Touch plays a fundamental role in our daily interactions, allowing us to interact with and perceive objects and their spatial properties. Despite its importance in the real-world, touch is often ignored in virtual environments. However, accurately simulating the sense of touch is difficult, requiring the use of high-fidelity haptic devices that are cost-prohibitive. Lower fidelity consumer-level haptic devices are becoming more widespread, yet are generally limited in perceived fidelity and the range of motion (degrees of freedom) required to realistically simulate many tasks. Studies into sound and vision suggest that the presence or absence of sound can influence task performance. Here, we explore whether the presence or absence of contextually relevant sound cues influences the performance of a simple haptic drilling task. Although the results of this study do not show any statistically significant difference in task performance with general (task-irrelevant) sound, we discuss how this is a necessary step in understanding the role of sound on haptic perception.

Authors and Affiliations

Mohammed Melaisi, David Rojas, Bill Kapralos, Alvaro Uribe-Quevedo and Karen Collins

Keywords

Related Articles

Large Scale Advanced Data Analytics on Skin Conditions from Genotype to Phenotype

A crucial factor in Big Data is to take advantage of available data and use that for new discovery or hypothesis generation. In this study, we analyzed Large-scale data from the literature to OMICS, such as the genome,...

Detecting Transitions in Manual Tasks from Wearables: An Unsupervised Labeling Approach†

Authoring protocols for manual tasks such as following recipes, manufacturing processes or laboratory experiments requires significant effort. This paper presents a system that estimates individual procedure transition...

Teaching HCI Skills in Higher Education through Game Design: A Study of Students’ Perceptions

Human-computer interaction (HCI) is an area with a wide range of concepts and knowledge. Therefore, a need to innovate in the teaching-learning processes to achieve an effective education arises. This article describes...

Scalable Interactive Visualization for Connectomics

Connectomics has recently begun to image brain tissue at nanometer resolution, which produces petabytes of data. This data must be aligned, labeled, proofread, and formed into graphs, and each step of this process requir...

Modelling Digital Knowledge Transfer: Nurse Supervisors Transforming Learning at Point of Care to Advance Nursing Practice

Limited adoption of mobile technology for informal learning and continuing professional development within Australian healthcare environments has been explained primarily as an issue of insufficient digital and ehealth...

Download PDF file
  • EP ID EP44157
  • DOI https://doi.org/10.3390/informatics5040043
  • Views 207
  • Downloads 0

How To Cite

Mohammed Melaisi, David Rojas, Bill Kapralos, Alvaro Uribe-Quevedo and Karen Collins (2018). Multimodal Interaction of Contextual and Non-Contextual Sound and Haptics in Virtual Simulations. Informatics, 5(4), -. https://www.europub.co.uk/articles/-A-44157