The use of questionnaires at the end of a specific task only evaluates what is expressed by the conscious mind and, therefore, cannot give a complete representation of the individual's emotional state. By adding data from physiological measures, such as cerebral activity, skin conductance, heart rate and gaze position, more accurate information about cognitive engagement and emotional responses to a given task could be provided. This study aims to evaluate participants' emotional (arousal, valence) and cognitive (memorization effort, attention, pleasantness) responses toward two videos, through the integration of above cited measures. Our findings show that the two tested videos produce two different unconscious reactions (one video causes a significantly higher increase in heart rate and the other one requires higher memorization effort), while producing similar conscious responses (no statistically significant differences were found by analyzing questionnaires' answers). Further, eye tracking device provided a way to investigate reasons behind these differences. The results show that the integration of self-reported and biological measures with eye tracking data could effectively help to understand emotional and cognitive responses during video observation.

Integrated data analysis for the quantification of emotional responses during video observation

Reali, Pierluigi;Cerutti, Sergio;Bianchi, Anna Maria;Bettiga, Debora;Lamberti, Lucio;Mazzola, Alessandra;Pillan, Margherita
2017

Abstract

The use of questionnaires at the end of a specific task only evaluates what is expressed by the conscious mind and, therefore, cannot give a complete representation of the individual's emotional state. By adding data from physiological measures, such as cerebral activity, skin conductance, heart rate and gaze position, more accurate information about cognitive engagement and emotional responses to a given task could be provided. This study aims to evaluate participants' emotional (arousal, valence) and cognitive (memorization effort, attention, pleasantness) responses toward two videos, through the integration of above cited measures. Our findings show that the two tested videos produce two different unconscious reactions (one video causes a significantly higher increase in heart rate and the other one requires higher memorization effort), while producing similar conscious responses (no statistically significant differences were found by analyzing questionnaires' answers). Further, eye tracking device provided a way to investigate reasons behind these differences. The results show that the integration of self-reported and biological measures with eye tracking data could effectively help to understand emotional and cognitive responses during video observation.
RTSI 2017 - IEEE 3rd International Forum on Research and Technologies for Society and Industry, Conference Proceedings
9781538639061
electroencephalogram; eye tracking; heart rate variability; skin conductance; Computer Networks and Communications; Computer Science Applications1707 Computer Vision and Pattern Recognition; Energy Engineering and Power Technology; Industrial and Manufacturing Engineering; Health (social science); Management of Technology and Innovation; Artificial Intelligence
File in questo prodotto:
File Dimensione Formato  
08065945.pdf

accesso aperto

Dimensione 1.5 MB
Formato Adobe PDF
1.5 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1038383
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 3
  • ???jsp.display-item.citation.isi??? 2
social impact