The Reality and Limitations of Implicit Control based on Passive Brain-Computer Interfacing

• Applicant: Professor Dr. Thorsten Zander
• Subject Area: Human Factors, Ergonomics, Human-Machine Systems ; Automation, Mechatronics, Control Systems, Intelligent Technical Systems, Robotics ; Human Cognitive and Systems Neuroscience
• Term: from 2016 to 2019
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 319237192

The proposed project concerns a new form of human-computer interaction (HCI) which we call implicit control. A unification of ideas and methods from the fields of, among others, physiological computing, adaptive automation, and passive brain-computer interfacing (pBCI) allows a fundamental HCI problem to be addressed: the still very asymmetrical and restrictive form of communication between a user and a machine, where the user must translate their ideas and intentions into a specific sequence of small commands (e.g. button presses, clicks, etc.). With pBCI, task-relevant information can be gathered from a user's ongoing brain activity directly, without requiring any additional effort from them. Using this information to build and adapt a user model in real time, a system can respond appropriately to the current cognitive and affective states of its user. Effectively, it is thus possible that a user controls a system without being aware of doing so--implicitly, through their covert states. We have demonstrated this proof of concept using a form of cursor control: implicitly, participants guided a cursor towards a target. Recognising the potential of such technology--the potential of natural HCI where the machine, as it were, actually understand its user--we now propose to further investigate the concept's potential and its limitations, building up on our functional proof of concept. Four essential aspects will be investigated. 1) The productive potential of implicit cursor control. Can selection decisions be made using this technology? Participants will steer the cursor towards one self-selected target out of multiple alternatives. 2) The potential of the technology to work with different interpretations on the side of the user. Can it also be detected which of multiple alternatives is least desirable? 3) The original demonstrator is event-related, but we have strong indications that a continuous interpretation of user state, and thus faster, continuous cursor control is possible. This will be investigated. 4) Ethical considerations play an important role as users using such systems may not be aware of the exact communication taking place. These and other ethical aspects of the technology, as well as potential user acceptance, will be investigated as well. The proposed project thus covers essential topics of interest related to this emerging technology, and will result in an initial overview of its possible future uses and applications, possible issues to be dealt with, and guidelines for designers and users with respect to ethical considerations.

• DFG Programme: Research Grants
• International Connection: USA
• Cooperation Partners: Professor Dr. Klaus Gramann; Professor Dr.-Ing. Moritz Arnd Michael Grosse-Wentrup; Professorin Dr. Virginia de Sa