Objectives: Changes in pupil size are governed by the autonomic nervous system but may be systematically driven by voluntary shifting the gaze in depth. Thus, the pupil accommodative response (PAR) that accompanies voluntary gaze shifts from a far to a near target might be exploited as a simple human-computer interface (HCI), bypassing the somato-motor system. Here we aim to characterize PAR in quasi-natural conditions with low-cost equipment and test the possibility to use PAR as a binary communication tool. Methods: Nineteen healthy subjects were instructed to voluntary switch the focus from a far to a near target upon presentation of an auditory cue. Three protocols addressed the effects of monocular/binocular vision, eye illuminance, duration of near vision, target texture and target brightness on PAR features. In a fourth protocol PAR was used to establish binary communication at different bit rates. Results: PAR amplitude decreased with increasing eye illuminance and was modulated by monocular/binocular vision, duration of near vision or target texture. PAR amplitude was larger with a bright near target and a dark far target than vice-versa. However, PAR was always clearly present, regardless of the experimental manipulations. PAR-based communication performance achieved an accuracy of 100% at 10 bits/min and 96% at 15 bits/min. Significance: Voluntary PAR is a robust signal, and can achieve a high communication speed when used as an HCI. This study provides a proof of concept for a PAR-based HCI, potentially useful to communicate with locked-in patients with preserved visual and autonomic functions.

A human-computer interface based on the “voluntary” pupil accommodative response / Ponzio, Francesco; Villalobos, Andres Eduardo Lorenzo; Mesin, Luca; De'Sperati, Claudio; Roatta, Silvestro. - In: INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES. - ISSN 1071-5819. - 126:(2019), pp. 53-63. [10.1016/j.ijhcs.2019.02.002]

A human-computer interface based on the “voluntary” pupil accommodative response

de'Sperati, Claudio;
2019-01-01

Abstract

Objectives: Changes in pupil size are governed by the autonomic nervous system but may be systematically driven by voluntary shifting the gaze in depth. Thus, the pupil accommodative response (PAR) that accompanies voluntary gaze shifts from a far to a near target might be exploited as a simple human-computer interface (HCI), bypassing the somato-motor system. Here we aim to characterize PAR in quasi-natural conditions with low-cost equipment and test the possibility to use PAR as a binary communication tool. Methods: Nineteen healthy subjects were instructed to voluntary switch the focus from a far to a near target upon presentation of an auditory cue. Three protocols addressed the effects of monocular/binocular vision, eye illuminance, duration of near vision, target texture and target brightness on PAR features. In a fourth protocol PAR was used to establish binary communication at different bit rates. Results: PAR amplitude decreased with increasing eye illuminance and was modulated by monocular/binocular vision, duration of near vision or target texture. PAR amplitude was larger with a bright near target and a dark far target than vice-versa. However, PAR was always clearly present, regardless of the experimental manipulations. PAR-based communication performance achieved an accuracy of 100% at 10 bits/min and 96% at 15 bits/min. Significance: Voluntary PAR is a robust signal, and can achieve a high communication speed when used as an HCI. This study provides a proof of concept for a PAR-based HCI, potentially useful to communicate with locked-in patients with preserved visual and autonomic functions.
2019
Human-computer interface; Locked-in syndrome; Pupil accommodative response; Vegetative reflex; Software; Human Factors and Ergonomics; 3304; Engineering (all); Human-Computer Interaction; Hardware and Architecture
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11768/86062
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 13
  • ???jsp.display-item.citation.isi??? 11
social impact