Human-Machine Interaction

Aurora Saibene

HMI Research Topic Supervisor

HUMAN-MACHINE INTERACTION

The Human-Machine Interaction (HMI), or Human-Computer Interaction (HCI), field is particularly interested in providing a bidirectional way of communication between humans and machines in real, virtual, and augmented environments.

The intriguing aspect of this field lies in its multidisciplinary nature, involving not only computer scientists, but also physicians, educators, entertainers, lawyers, and many other figures with very diverse backgrounds.

In the MMSP lab we mainly focus on the computational methods pertaining advanced human-system interaction with sensors:

  • Brain-Computer Interfaces
    • Motor imagery
    • Inner speech
  • HMI systems for emotion and mood detection
  • HMI systems for behaviour understanding

In particular we study electroencephalographic, electromyographic, photoplethysmographic, and galvanic skin response physiological data acquired through wearable and portable devices.

Brain-Computer Interfaces

Brain-Computer Interfaces (BCI) provide both a translation of neural signals into machine commands and a feedback to the BCI users.

Among the BCI applications, the MMSP lab focuses on ...

Motor imagery

Motor imagery (MI) tasks involve the imagination of voluntary movements and represent good allies for neuroplasticity, which is the ability that the brain has to change its structure in response to new situations.

In the EEG field, considering the characteristics of motor imagery, the MI tasks have been exploited especially when having to deal with Brain Computer Interfaces (BCIs), which allow an on-line decoding of brain dynamics and can be exploited to control heterogeneous systems (e.g., wheelchairs).

Inner speech

Inner speech recognition is defined as the internalised process in which the person thinks in pure meanings, generally associated with an auditory imagery of own inner “voice”.

Speech-related brain computer interfaces provide effective vocal communication strategies for controlling devices through speech commands interpreted from brain signals, improving the quality of life of people who have lost the capability to speak, by restoring communication with their environment.

Used Devices

The MMSP lab is now focusing on the use of wearable and portable devices, in particular for the HMI research topics we are using ...

Unicorn Hybrid Black

Unicorn Hybrid Black (g.tec medical engineering GmbH).

Shimmer3 GSR+ Unit

The data recorded through Shimmer3 GSR+ (http://www.shimmersensing.com/) are: heart rate and GSR.