27 April 2018 iSight: computer vision based system to assist low vision
Author Affiliations +
iSight is a mobile application to assist low vision people with the everyday task of sight. Specifically, the goal of the system is using 2D computer vision to refocus and visualize specific objects recognized in the image in an Augmented Reality scheme. This paper discusses the development of the application that uses a deep learning TensorFlow module to perform recognition of objects in the scene the user is looking at and consequently directs the formation of an augmented reality scene which is presented to the user to enhance their visual understanding. Both indoor and outdoor environments are tested and results are given. The success and challenges faced by iSight are presented along with future avenues of work.
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Lynne Grewe, Lynne Grewe, Archana Kashyap, Archana Kashyap, Krishnan Chandran, Krishnan Chandran, Allen Shahshahani, Allen Shahshahani, Jake Shahshahani, Jake Shahshahani, } "iSight: computer vision based system to assist low vision", Proc. SPIE 10646, Signal Processing, Sensor/Information Fusion, and Target Recognition XXVII, 1064613 (27 April 2018); doi: 10.1117/12.2305233; https://doi.org/10.1117/12.2305233


Matching 3D segmented objects using wire frame analysis
Proceedings of SPIE (August 06 1993)
Role of computer vision in augmented virtual reality
Proceedings of SPIE (March 30 1995)
Computer vision camera with embedded FPGA processing
Proceedings of SPIE (March 21 2000)
Biocybrid systems and the re-engineering of life
Proceedings of SPIE (January 27 2011)
Vision-based natural feature tracking for augmented reality
Proceedings of SPIE (September 05 2002)

Back to Top