Variational Autoencoder for Image-Based Augmentation of Eye-Tracking Data. 2021

Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
Laboratoire Modélisation, Information, Systèmes (MIS), Université de Picardie Jules Verne, 80080 Amiens, France.

Over the past decade, deep learning has achieved unprecedented successes in a diversity of application domains, given large-scale datasets. However, particular domains, such as healthcare, inherently suffer from data paucity and imbalance. Moreover, datasets could be largely inaccessible due to privacy concerns, or lack of data-sharing incentives. Such challenges have attached significance to the application of generative modeling and data augmentation in that domain. In this context, this study explores a machine learning-based approach for generating synthetic eye-tracking data. We explore a novel application of variational autoencoders (VAEs) in this regard. More specifically, a VAE model is trained to generate an image-based representation of the eye-tracking output, so-called scanpaths. Overall, our results validate that the VAE model could generate a plausible output from a limited dataset. Finally, it is empirically demonstrated that such approach could be employed as a mechanism for data augmentation to improve the performance in classification tasks.

UI MeSH Term Description Entries

Related Publications

Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
September 2023, Academic radiology,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
March 2021, Accident; analysis and prevention,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
October 2022, IEEE transactions on cybernetics,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
March 2023, IEEE transactions on pattern analysis and machine intelligence,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
January 2025, Nuclear medicine review. Central & Eastern Europe,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
January 2016, IEEE transactions on visualization and computer graphics,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
January 2022, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
July 2019, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
December 2023, Medical image analysis,
Mahmoud Elbattah, and Colm Loughnane, and Jean-Luc Guérin, and Romuald Carette, and Federica Cilia, and Gilles Dequen
June 2025, Computer methods and programs in biomedicine,
Copied contents to your clipboard!