Sky Writer: Sketch-based collaboration for UAV pilots and mission specialists

Zachary Henkel, Jesus Suarez, Brittany Duncan, Robin R. Murphy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Sky Writer is a collaborative communication medium that augments the traditional display of a UAV pilot and allows other stakeholders to communicate their needs and intentions to the pilot. UAV pilots engaging in time-critical missions, such as urban disaster responses, often must allocate most of their cognitive capacity towards flight tasks, making communication and collaboration with other stakeholders difficult or dangerous. Sky Writer addresses the needs of stakeholders while requiring minimal cognitive effort from the UAV pilot. The application presents stakeholders with an interface that provides contextual flight information and a live video stream of the flight. Stakeholders are able to sketch directly on the video stream or use a spotlight indicator that is mirrored across all displays in the system, including the pilot's display. The application can be used in any modern web browser and works with traditional and touch devices. Concept experimentation performed at Disaster City with two pilots indicated that the spotlight feature was particularly useful while the UAV was in motion, and the sketching features were most useful while the UAV was stationary. The system will be tested with professional responders soon to determine its efficacy in a simulated response, and to inform the ongoing design process.

Original languageEnglish (US)
Title of host publicationHRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction
PublisherIEEE Computer Society
Pages172-173
Number of pages2
ISBN (Print)9781450326582
DOIs
StatePublished - Jan 1 2014
Event9th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2014 - Bielefeld, Germany
Duration: Mar 3 2014Mar 6 2014

Publication series

NameACM/IEEE International Conference on Human-Robot Interaction
ISSN (Electronic)2167-2148

Other

Other9th Annual ACM/IEEE International Conference on Human-Robot Interaction, HRI 2014
CountryGermany
CityBielefeld
Period3/3/143/6/14

    Fingerprint

Keywords

  • Sketch interface
  • Unmanned aerial vehicles

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Electrical and Electronic Engineering

Cite this

Henkel, Z., Suarez, J., Duncan, B., & Murphy, R. R. (2014). Sky Writer: Sketch-based collaboration for UAV pilots and mission specialists. In HRI 2014 - Proceedings of the 2014 ACM/IEEE International Conference on Human-Robot Interaction (pp. 172-173). (ACM/IEEE International Conference on Human-Robot Interaction). IEEE Computer Society. https://doi.org/10.1145/2559636.2559838