Title: Plug-and-play supervisory control using muscle and brain signals for real-time gesture and error detection
Authors: DelPreto, Joseph 
Salazar-Gomez, Andres F. 
Gil, Stephanie 
Hasani, Ramin  
Guenther, Frank H. 
Rus, Daniela 
Category: Original Research Article
Issue Date: 9-Aug-2020
Journal: Autonomous Robots 
ISSN: 0929-5593
Effective human supervision of robots can be key for ensuring correct robot operation in a variety of potentially safety-critical scenarios. This paper takes a step towards fast and reliable human intervention in supervisory control tasks by combining two streams of human biosignals: muscle and brain activity acquired via EMG and EEG, respectively. It presents continuous classification of left and right hand-gestures using muscle signals, time-locked classification of error-related potentials using brain signals (unconsciously produced when observing an error), and a framework that combines these pipelines to detect and correct robot mistakes during multiple-choice tasks. The resulting hybrid system is evaluated in a “plug-and-play” fashion with 7 untrained subjects supervising an autonomous robot performing a target selection task. Offline analysis further explores the EMG classification performance, and investigates methods to select subsets of training data that may facilitate generalizable plug-and-play classifiers.
Keywords: Human–robot interaction; EMG control; EEG control; Hybrid control structure; Plug-and-play supervisory control; Error-related potentials; Gesture detection; machine learning; control; human-machine interface; robotics
DOI: 10.1007/s10514-020-09916-x
Organisation: E191 - Institut für Computer Engineering 
License: CC BY 4.0 CC BY 4.0
Publication Type: Article
Appears in Collections:Article

Files in this item:

Show full item record

Page view(s)

checked on Apr 13, 2021


checked on Apr 13, 2021

Google ScholarTM


This item is licensed under a Creative Commons License Creative Commons