TY - GEN
T1 - Longitudinal Classification of Mental Effort Using Electrodermal Activity, Heart Rate, and Skin Temperature Data From a Wearable Sensor
AU - Romine, William
AU - Schroeder, Noah
AU - Edwards, Anjali
AU - Banerjee, Tanvi
N1 - Publisher Copyright:
© Springer Nature Switzerland AG 2021.
PY - 2021
Y1 - 2021
N2 - Recent studies show that physiological data can detect changes in mental effort, making way for the development of wearable sensors to monitor mental effort in school, work, and at home. We have yet to explore how such a device would work with a single participant over an extended time duration. We used a longitudinal case study design with ~38 h of data to explore the efficacy of electrodermal activity, skin temperature, and heart rate for classifying mental effort. We utilized a 2-state Markov switching regression model to understand the efficacy of these physiological measures for predicting self-reported mental effort during logged activities. On average, a model with state-dependent relationships predicted within one unit of reported mental effort (training RMSE = 0.4, testing RMSE = 0.7). This automated sensing of mental effort can have applications in various domains including student engagement detection and cognitive state assessment in drivers, pilots, and caregivers.
AB - Recent studies show that physiological data can detect changes in mental effort, making way for the development of wearable sensors to monitor mental effort in school, work, and at home. We have yet to explore how such a device would work with a single participant over an extended time duration. We used a longitudinal case study design with ~38 h of data to explore the efficacy of electrodermal activity, skin temperature, and heart rate for classifying mental effort. We utilized a 2-state Markov switching regression model to understand the efficacy of these physiological measures for predicting self-reported mental effort during logged activities. On average, a model with state-dependent relationships predicted within one unit of reported mental effort (training RMSE = 0.4, testing RMSE = 0.7). This automated sensing of mental effort can have applications in various domains including student engagement detection and cognitive state assessment in drivers, pilots, and caregivers.
KW - Cognitive assessment
KW - Cognitive load
KW - Machine learning
KW - Mental effort
KW - Wearable sensor
UR - http://www.scopus.com/inward/record.url?scp=85110606805&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85110606805&partnerID=8YFLogxK
UR - https://corescholar.libraries.wright.edu/cse/630
U2 - 10.1007/978-3-030-68790-8_8
DO - 10.1007/978-3-030-68790-8_8
M3 - Conference contribution
AN - SCOPUS:85110606805
SN - 9783030687892
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 86
EP - 95
BT - Pattern Recognition
A2 - Del Bimbo, Alberto
A2 - Bertini, Marco
A2 - Sclaroff, Stan
A2 - Mei, Tao
A2 - Escalante, Hugo Jair
A2 - Cucchiara, Rita
A2 - Vezzani, Roberto
A2 - Farinella, Giovanni Maria
PB - Springer Science and Business Media Deutschland GmbH
T2 - 25th International Conference on Pattern Recognition Workshops, ICPR 2020
Y2 - 10 January 2021 through 15 January 2021
ER -