27 April 2018 iSight: computer vision based system to assist low vision
Author Affiliations +
iSight is a mobile application to assist low vision people with the everyday task of sight. Specifically, the goal of the system is using 2D computer vision to refocus and visualize specific objects recognized in the image in an Augmented Reality scheme. This paper discusses the development of the application that uses a deep learning TensorFlow module to perform recognition of objects in the scene the user is looking at and consequently directs the formation of an augmented reality scene which is presented to the user to enhance their visual understanding. Both indoor and outdoor environments are tested and results are given. The success and challenges faced by iSight are presented along with future avenues of work.
Conference Presentation
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Lynne Grewe, Lynne Grewe, Archana Kashyap, Archana Kashyap, Krishnan Chandran, Krishnan Chandran, Allen Shahshahani, Allen Shahshahani, Jake Shahshahani, Jake Shahshahani, "iSight: computer vision based system to assist low vision", Proc. SPIE 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII, 1064613 (27 April 2018); doi: 10.1117/12.2305233; https://doi.org/10.1117/12.2305233


Matching 3D segmented objects using wire frame analysis
Proceedings of SPIE (August 05 1993)
Role of computer vision in augmented virtual reality
Proceedings of SPIE (March 29 1995)
Line-scan vision systems
Proceedings of SPIE (December 16 1993)
Computer vision camera with embedded FPGA processing
Proceedings of SPIE (March 20 2000)
Biocybrid systems and the re-engineering of life
Proceedings of SPIE (January 27 2011)
Vision-based natural feature tracking for augmented reality
Proceedings of SPIE (September 04 2002)

Back to Top