Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning

Evangelou, George; Georgiou, Orestis; Brown, Eddie and Moore, James W.. 2025. Sense of agency in gesture-based interactions: modulated by sensory modality but not feedback meaning. Frontiers in Computer Science, 7, 1511928. ISSN 2624-9898 [Article]
Copy

Introduction: Gesture-based interactions provide control over a system without the need for physical contact. Mid-air haptic technology allows a user to not visually engage with the interface while receiving system information and is readily manipulable, which has positive implications for automotive environments. It is important, however, that the user still feels a sense of agency, which here refers to perceiving system changes as caused by their gesture.

Methods: In the current study, 36 participants engaged in an experimental time perception task with an automotive-themed infotainment menu, serving as an implicit quantitative measure of agency. This was supplemented with additional self-reported measures. They selected different icons via gesture poses, with sensory feedback either visually or haptically. In addition, (sensory) feedback was also the same for each icon, arbitrarily different or carried semantic information.

Results: Mid-air haptics increased agency compared to visual, and this did not vary as a function of feedback meaning. Agency was also associated with general measures of trust and usability.

Discussion: Our findings demonstrate positive implications for mid-air haptics in automotive contexts and highlight the general importance of user agency.


picture_as_pdf
Sense of agency in gesture-based interactions modulated by sensory modality but not feedback meaning.pdf
subject
Published Version
Available under Creative Commons: Attribution 4.0

View Download

Atom BibTeX OpenURL ContextObject in Span OpenURL ContextObject Dublin Core Dublin Core MPEG-21 DIDL Data Cite XML EndNote HTML Citation METS MODS RIOXX2 XML Reference Manager Refer ASCII Citation
Export

Downloads