Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

Ming Jiang; Sunday Francis; Angela Tseng; Diksha Srishyla; Megan Dubois; Katie Beard; Christine A Conelea; Qi Zhao; Suma Jacob

doi:10.1109/EMBC44109.2020.9176843

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

Ming Jiang, Sunday Francis, Angela Tseng, Diksha Srishyla, Megan Dubois, Katie Beard, Christine A Conelea, Qi Zhao, Suma Jacob

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Scopus citations

Abstract

Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.

Original language	English (US)
Title of host publication	42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society
Subtitle of host publication	Enabling Innovative Technologies for Global Healthcare, EMBC 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	871-875
Number of pages	5
ISBN (Electronic)	9781728119908
DOIs	https://doi.org/10.1109/EMBC44109.2020.9176843
State	Published - Jul 2020
Event	42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 - Montreal, Canada Duration: Jul 20 2020 → Jul 24 2020

Publication series

Name	Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
Volume	2020-July
ISSN (Print)	1557-170X

Conference

Conference	42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020
Country/Territory	Canada
City	Montreal
Period	7/20/20 → 7/24/20

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

Access

10.1109/EMBC44109.2020.9176843

OpenUrl availability

Full text

Cite this

Jiang, M., Francis, S., Tseng, A., Srishyla, D., Dubois, M., Beard, K., Conelea, C. A., Zhao, Q., & Jacob, S. (2020). Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. In 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020 (pp. 871-875). Article 9176843 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2020-July). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC44109.2020.9176843

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. / Jiang, Ming; Francis, Sunday; Tseng, Angela et al.
42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 871-875 9176843 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS; Vol. 2020-July).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jiang, M, Francis, S, Tseng, A, Srishyla, D, Dubois, M, Beard, K, Conelea, CA , Zhao, Q & Jacob, S 2020, Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. in 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020., 9176843, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, vol. 2020-July, Institute of Electrical and Electronics Engineers Inc., pp. 871-875, 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020, Montreal, Canada, 7/20/20. https://doi.org/10.1109/EMBC44109.2020.9176843

Jiang M, Francis S, Tseng A, Srishyla D, Dubois M, Beard K et al. Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. In 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 871-875. 9176843. (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). doi: 10.1109/EMBC44109.2020.9176843

Jiang, Ming ; Francis, Sunday ; Tseng, Angela et al. / Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth. 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society: Enabling Innovative Technologies for Global Healthcare, EMBC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 871-875 (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS).

@inproceedings{643aa45f884942f58a9c3b997a4e0266,

title = "Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth",

abstract = "Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.",

author = "Ming Jiang and Sunday Francis and Angela Tseng and Diksha Srishyla and Megan Dubois and Katie Beard and Conelea, {Christine A} and Qi Zhao and Suma Jacob",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020 ; Conference date: 20-07-2020 Through 24-07-2020",

year = "2020",

month = jul,

doi = "10.1109/EMBC44109.2020.9176843",

language = "English (US)",

series = "Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "871--875",

booktitle = "42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society",

}

TY - GEN

T1 - Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

AU - Jiang, Ming

AU - Francis, Sunday

AU - Tseng, Angela

AU - Srishyla, Diksha

AU - Dubois, Megan

AU - Beard, Katie

AU - Conelea, Christine A

AU - Zhao, Qi

AU - Jacob, Suma

PY - 2020/7

Y1 - 2020/7

N2 - Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.

AB - Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder (NDD) with a high rate of comorbidity. The implementation of eye-tracking methodologies has informed behavioral and neurophysiological patterns of visual processing across ASD and comorbid NDDs. In this study, we propose a machine learning method to predict measures of two core ASD characteristics: impaired social interactions and communication, and restricted, repetitive, and stereotyped behaviors and interests. Our method extracts behavioral features from task performance and eye-tracking data collected during a facial emotion recognition paradigm. We achieved high regression accuracy using a Random Forest regressor trained to predict scores on the SRS-2 and RBS-R assessments; this approach may serve as a classifier for ASD diagnosis.

UR - http://www.scopus.com/inward/record.url?scp=85091001196&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85091001196&partnerID=8YFLogxK

U2 - 10.1109/EMBC44109.2020.9176843

DO - 10.1109/EMBC44109.2020.9176843

M3 - Conference contribution

C2 - 33018123

AN - SCOPUS:85091001196

T3 - Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS

SP - 871

EP - 875

BT - 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 42nd Annual International Conferences of the IEEE Engineering in Medicine and Biology Society, EMBC 2020

Y2 - 20 July 2020 through 24 July 2020

ER -

Predicting Core Characteristics of ASD Through Facial Emotion Recognition and Eye Tracking in Youth

Abstract

Publication series

Conference

Bibliographical note

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this