Convolutional Neural Network for Prediction of Autism based on Eye-tracking Scanpaths

Authors

  • Zeyad A.T. Ahmed PhD Research Scholar, Department of Computer Science, Dr. Babasaheb Ambedkar Marathwada University, Aurangabad, India. Author
  • Dr. Mukti E. Jadhav Prof & Principal of Marathwada Institute of Technology, Dr. Babasaheb Ambedkar Marathwada University, Aurangabad, India. Author

DOI:

https://doi.org/10.61841/kpqpc028

Keywords:

Autism Spectrum Disorder (ASD), Typical Developing (TD), Eye Tracking, Scanpath, Convolutional Neural Network (CNN)

Abstract

Autism Spectrum Disorder (ASD), difficulty in socialization, can be detected by observation of atypical visual attention of children. Eye tracking is one of the most important techniques used in providing information on visual behavior as a statistically motivated step towards the accurate diagnosis of such disorders. The scanpath, sequences of fixations of the eyes on an image, provides data related to the locations and durations of the gazes that can be used to develop visual patterns to analyze the visual behavior of children. The aim of this paper is to develop a deep learning model implementing a convolutional neural network (CNN) to classify children as autistic or typically developing according to eye-tracking scanpaths. The model was applied to 29 autistic and 30 normal children and achieved 98% testing accuracy. 

Downloads

Download data is not yet available.

References

[1] Zeyad Abdulhameed Taha Ahmed and Mukti E. Jadhav , A Review of Early Detection of Autism Based on Eye-Tracking and Sensing Technology, 5th International Conference on Inventive Computation Technologies (ICICT-2020), INDIA, IEEE. “Under Publication”

[2] Carette, R., Elbattah, M., Dequen, G., Guérin, J., Cilia, F., & Bosche, J. (2019). Learning to predict autism spectrum disorder based on the visual patterns of eye-tracking scanpaths. In Proceedings of the 12th International Conference on Health Informatics.

[3] https://figshare.com/articles/Visualization_of_EyeTracking_Scanpaths_in_Autism_Spectrum_Disorder_Image_Dataset/7073087/1 age_Dataset/7073087/1

[4] Elbattah, M., Carette, R., Dequen, G., Guérin, J. L., & Cilia, F. (2019, July). Learning Clusters in Autism Spectrum Disorder: Image-Based Clustering of Eye-Tracking Scanpaths with Deep Autoencoder. In 2019

41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 1417-1420). IEEE.

[5] Goldberg, J. H., & Helfman, J. I. (2010, March). Visual scanpath representation. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications (pp. 203-210).

[6] Rutherford, M. D., & Towns, A. M. (2008). Scan path differences and similarities during emotion perception in those with and without autism spectrum disorders. Journal of Autism and Developmental Disorders, 38(7), 1371-1381.

[7] Jiang, M., & Zhao, Q. (2017). Learning visual attention to identify people with autism spectrum disorder. In Proceedings of the IEEE International Conference on Computer Vision (pp. 3267-3276).

[8] Wu, C., Liaqat, S., Cheung, S. C., Chuah, C. N., & Ozonoff, S. (2019, July). Predicting Autism Diagnosis using Images with Fixations and Synthetic Saccade Patterns. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (pp. 647-650). IEEE.

[9] Tao, Y., & Shyu, M. L. (2019, July). SP-ASDNet: CNN-LSTM-Based ASD Classification Model Using Observer Scanpaths. In 2019 IEEE International Conference on Multimedia & Expo Workshops (ICMEW) (pp. 641-646). IEEE

[10] Xie, J., Wang, L., Webster, P., Yao, Y., Sun, J., Wang, S., & Zhou, H. (2019). A Two-Stream End-to-End Deep Learning Network for Recognizing Atypical Visual Attention in Autism Spectrum Disorder. arXiv preprint arXiv:1911.11393.

[11] Mohamed Elgendy, (2019) Deep Learning for Vision Systems, available online at https://www.manning.com.

Downloads

Published

31.07.2020

How to Cite

A.T. Ahmed, Z., & E. Jadhav, M. (2020). Convolutional Neural Network for Prediction of Autism based on Eye-tracking Scanpaths. International Journal of Psychosocial Rehabilitation, 24(5), 2683-2689. https://doi.org/10.61841/kpqpc028