Eye tracking and EEG synchronization to analyze microsaccades during a workload task

Indu P. Bodala, Sunil Kukreja, Junhua Li, Nitish V Thakor, Hasan Al-Nashash

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Electroencephalography (EEG) and eye tracking are two fields that have evolved independently to study topics such as mental workload, attention and fatigue in cognitive neuroscience. However, little research has been devoted to integrating data from these two fields. In this paper, we investigate the utility of a specific type of eye movement, microsaccades, to analyze cognitive activity. We assess mental workload using event related potentials (ERPs) correlated with microsaccades during experiments where task complexity is designed to be greater with an increase in visual degradation. We also develop a modified eye movement algorithm to identify microsaccades during tasks that permit regular saccades and blinks. We compare ERPs at microsaccade onset locked epochs to those of stimulus onset locked epochs. Our results show a clear correlation of ERP activations to both latency and activation areas. These findings provide important insights for analyzing sophisticated tasks in a non-invasive fashion.

Original languageEnglish (US)
Title of host publicationProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages7994-7997
Number of pages4
Volume2015-November
ISBN (Print)9781424492718
DOIs
StatePublished - Nov 4 2015
Externally publishedYes
Event37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015 - Milan, Italy
Duration: Aug 25 2015Aug 29 2015

Other

Other37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015
CountryItaly
CityMilan
Period8/25/158/29/15

Fingerprint

Eye movements
Electroencephalography
Workload
Evoked Potentials
Synchronization
Eye Movements
Chemical activation
Saccades
Fatigue
Fatigue of materials
Degradation
Research
Experiments

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Biomedical Engineering
  • Health Informatics

Cite this

Bodala, I. P., Kukreja, S., Li, J., Thakor, N. V., & Al-Nashash, H. (2015). Eye tracking and EEG synchronization to analyze microsaccades during a workload task. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS (Vol. 2015-November, pp. 7994-7997). [7320247] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2015.7320247

Eye tracking and EEG synchronization to analyze microsaccades during a workload task. / Bodala, Indu P.; Kukreja, Sunil; Li, Junhua; Thakor, Nitish V; Al-Nashash, Hasan.

Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November Institute of Electrical and Electronics Engineers Inc., 2015. p. 7994-7997 7320247.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Bodala, IP, Kukreja, S, Li, J, Thakor, NV & Al-Nashash, H 2015, Eye tracking and EEG synchronization to analyze microsaccades during a workload task. in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. vol. 2015-November, 7320247, Institute of Electrical and Electronics Engineers Inc., pp. 7994-7997, 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2015, Milan, Italy, 8/25/15. https://doi.org/10.1109/EMBC.2015.7320247
Bodala IP, Kukreja S, Li J, Thakor NV, Al-Nashash H. Eye tracking and EEG synchronization to analyze microsaccades during a workload task. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November. Institute of Electrical and Electronics Engineers Inc. 2015. p. 7994-7997. 7320247 https://doi.org/10.1109/EMBC.2015.7320247
Bodala, Indu P. ; Kukreja, Sunil ; Li, Junhua ; Thakor, Nitish V ; Al-Nashash, Hasan. / Eye tracking and EEG synchronization to analyze microsaccades during a workload task. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS. Vol. 2015-November Institute of Electrical and Electronics Engineers Inc., 2015. pp. 7994-7997
@inproceedings{d2f3fab228b94aa29a9be0a071afd0fe,
title = "Eye tracking and EEG synchronization to analyze microsaccades during a workload task",
abstract = "Electroencephalography (EEG) and eye tracking are two fields that have evolved independently to study topics such as mental workload, attention and fatigue in cognitive neuroscience. However, little research has been devoted to integrating data from these two fields. In this paper, we investigate the utility of a specific type of eye movement, microsaccades, to analyze cognitive activity. We assess mental workload using event related potentials (ERPs) correlated with microsaccades during experiments where task complexity is designed to be greater with an increase in visual degradation. We also develop a modified eye movement algorithm to identify microsaccades during tasks that permit regular saccades and blinks. We compare ERPs at microsaccade onset locked epochs to those of stimulus onset locked epochs. Our results show a clear correlation of ERP activations to both latency and activation areas. These findings provide important insights for analyzing sophisticated tasks in a non-invasive fashion.",
author = "Bodala, {Indu P.} and Sunil Kukreja and Junhua Li and Thakor, {Nitish V} and Hasan Al-Nashash",
year = "2015",
month = "11",
day = "4",
doi = "10.1109/EMBC.2015.7320247",
language = "English (US)",
isbn = "9781424492718",
volume = "2015-November",
pages = "7994--7997",
booktitle = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Eye tracking and EEG synchronization to analyze microsaccades during a workload task

AU - Bodala, Indu P.

AU - Kukreja, Sunil

AU - Li, Junhua

AU - Thakor, Nitish V

AU - Al-Nashash, Hasan

PY - 2015/11/4

Y1 - 2015/11/4

N2 - Electroencephalography (EEG) and eye tracking are two fields that have evolved independently to study topics such as mental workload, attention and fatigue in cognitive neuroscience. However, little research has been devoted to integrating data from these two fields. In this paper, we investigate the utility of a specific type of eye movement, microsaccades, to analyze cognitive activity. We assess mental workload using event related potentials (ERPs) correlated with microsaccades during experiments where task complexity is designed to be greater with an increase in visual degradation. We also develop a modified eye movement algorithm to identify microsaccades during tasks that permit regular saccades and blinks. We compare ERPs at microsaccade onset locked epochs to those of stimulus onset locked epochs. Our results show a clear correlation of ERP activations to both latency and activation areas. These findings provide important insights for analyzing sophisticated tasks in a non-invasive fashion.

AB - Electroencephalography (EEG) and eye tracking are two fields that have evolved independently to study topics such as mental workload, attention and fatigue in cognitive neuroscience. However, little research has been devoted to integrating data from these two fields. In this paper, we investigate the utility of a specific type of eye movement, microsaccades, to analyze cognitive activity. We assess mental workload using event related potentials (ERPs) correlated with microsaccades during experiments where task complexity is designed to be greater with an increase in visual degradation. We also develop a modified eye movement algorithm to identify microsaccades during tasks that permit regular saccades and blinks. We compare ERPs at microsaccade onset locked epochs to those of stimulus onset locked epochs. Our results show a clear correlation of ERP activations to both latency and activation areas. These findings provide important insights for analyzing sophisticated tasks in a non-invasive fashion.

UR - http://www.scopus.com/inward/record.url?scp=84953332970&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84953332970&partnerID=8YFLogxK

U2 - 10.1109/EMBC.2015.7320247

DO - 10.1109/EMBC.2015.7320247

M3 - Conference contribution

C2 - 26738147

AN - SCOPUS:84953332970

SN - 9781424492718

VL - 2015-November

SP - 7994

EP - 7997

BT - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

PB - Institute of Electrical and Electronics Engineers Inc.

ER -