Real-time, deep-learning aided lensless microscope. 2023

Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
Department of Bioengineering, Rice University, Houston, Texas 77005, USA.

Traditional miniaturized fluorescence microscopes are critical tools for modern biology. Invariably, they struggle to simultaneously image with a high spatial resolution and a large field of view (FOV). Lensless microscopes offer a solution to this limitation. However, real-time visualization of samples is not possible with lensless imaging, as image reconstruction can take minutes to complete. This poses a challenge for usability, as real-time visualization is a crucial feature that assists users in identifying and locating the imaging target. The issue is particularly pronounced in lensless microscopes that operate at close imaging distances. Imaging at close distances requires shift-varying deconvolution to account for the variation of the point spread function (PSF) across the FOV. Here, we present a lensless microscope that achieves real-time image reconstruction by eliminating the use of an iterative reconstruction algorithm. The neural network-based reconstruction method we show here, achieves more than 10000 times increase in reconstruction speed compared to iterative reconstruction. The increased reconstruction speed allows us to visualize the results of our lensless microscope at more than 25 frames per second (fps), while achieving better than 7 µm resolution over a FOV of 10 mm2. This ability to reconstruct and visualize samples in real-time empowers a more user-friendly interaction with lensless microscopes. The users are able to use these microscopes much like they currently do with conventional microscopes.

UI MeSH Term Description Entries

Related Publications

Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
January 2022, PloS one,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
July 2023, Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
February 2018, Scientific reports,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
March 2020, Accident; analysis and prevention,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
January 2021, Computational intelligence and neuroscience,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
August 2022, Optics express,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
February 2022, Scientific reports,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
June 2020, Journal of biophotonics,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
July 2020, Scientific reports,
Jimin Wu, and Vivek Boominathan, and Ashok Veeraraghavan, and Jacob T Robinson
September 2023, Sensors (Basel, Switzerland),
Copied contents to your clipboard!