Longitudinal Classification of Mental Effort Using Electrodermal Activity, Heart Rate, and Skin Temperature Data From a Wearable Sensor

William Romine, Noah Schroeder, Anjali Edwards, Tanvi Banerjee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recent studies show that physiological data can detect changes in mental effort, making way for the development of wearable sensors to monitor mental effort in school, work, and at home. We have yet to explore how such a device would work with a single participant over an extended time duration. We used a longitudinal case study design with ~38 h of data to explore the efficacy of electrodermal activity, skin temperature, and heart rate for classifying mental effort. We utilized a 2-state Markov switching regression model to understand the efficacy of these physiological measures for predicting self-reported mental effort during logged activities. On average, a model with state-dependent relationships predicted within one unit of reported mental effort (training RMSE = 0.4, testing RMSE = 0.7). This automated sensing of mental effort can have applications in various domains including student engagement detection and cognitive state assessment in drivers, pilots, and caregivers.
Original languageEnglish
Title of host publicationPattern Recognition
Subtitle of host publicationICPR International Workshops and Challenges, Proceedings
EditorsAlberto Del Bimbo, Marco Bertini, Stan Sclaroff, Tao Mei, Hugo Jair Escalante, Rita Cucchiara, Roberto Vezzani, Giovanni Maria Farinella
PublisherSpringer Science and Business Media Deutschland GmbH
Pages86-95
Number of pages10
ISBN (Electronic)978-3-030-68790-8
ISBN (Print)9783030687892
DOIs
StatePublished - 2021
Event25th International Conference on Pattern Recognition Workshops, ICPR 2020 - Virtual, Online
Duration: Jan 10 2021Jan 15 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12662 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference25th International Conference on Pattern Recognition Workshops, ICPR 2020
CityVirtual, Online
Period1/10/211/15/21

ASJC Scopus Subject Areas

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Cognitive assessment
  • Cognitive load
  • Machine learning
  • Mental effort
  • Wearable sensor

Disciplines

  • Physiology
  • Biology

Cite this