Human gaze commands classification: A shape based approach to interfacing with robots

Trevor Lynn Craig, Carl A. Nelson, Songpo Li, Xiaoli Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

The sense of sight is one of the main outlets to how we interact with the world around us. Using eye tracking methods, this sensory input channel may also be used as an output channel to provide commands for robots to follow. These gaze-commanded robots could then be used to assist severely mobility-limited individuals in the home or similar environments. This paper explores the use of visually drawn shapes as the input for robot commands. These commands were recorded using low-cost gaze tracking hardware (Gazepoint GP3 Eye Tracker). The data were then processed using a custom algorithm in MATLAB to detect commands to be passed to a small humanoid robot (NAO). Using the techniques and procedures given in this paper, people with limited mobility will be able to input shape commands to have robots like NAO react as personal assistants. This is also extensible to gaze-based human-machine interfaces in general for a variety of applications.

Original languageEnglish (US)
Title of host publicationMESA 2016 - 12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509061907
DOIs
StatePublished - Oct 7 2016
Event12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, MESA 2016 - Auckland, New Zealand
Duration: Aug 29 2016Aug 31 2016

Publication series

NameMESA 2016 - 12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications - Conference Proceedings

Other

Other12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, MESA 2016
Country/TerritoryNew Zealand
CityAuckland
Period8/29/168/31/16

Keywords

  • Assistive Robot
  • Gaze
  • Gaze Tracking
  • Gaze-based Control
  • Human-Robot Interaction
  • Shape Recognition

ASJC Scopus subject areas

  • Biomedical Engineering
  • Industrial and Manufacturing Engineering
  • Mechanical Engineering
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Human gaze commands classification: A shape based approach to interfacing with robots'. Together they form a unique fingerprint.

Cite this