17 March 2017 Fast integer approximations in convolutional neural networks using layer-by-layer training
Author Affiliations +
Proceedings Volume 10341, Ninth International Conference on Machine Vision (ICMV 2016); 103410Q (2017) https://doi.org/10.1117/12.2268722
Event: Ninth International Conference on Machine Vision, 2016, Nice, France
Abstract
This paper explores method of layer-by-layer training for neural networks to train neural network, that use approximate calculations and/or low precision data types. Proposed method allows to improve recognition accuracy using standard training algorithms and tools. At the same time, it allows to speed up neural network calculations using fast-processed approximate calculations and compact data types. We consider 8-bit fixed-point arithmetic as the example of such approximation for image recognition problems. In the end, we show significant accuracy increase for considered approximation along with processing speedup.
© (2017) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Dmitry Ilin, Dmitry Ilin, Elena Limonova, Elena Limonova, Vladimir Arlazarov, Vladimir Arlazarov, Dmitry Nikolaev, Dmitry Nikolaev, } "Fast integer approximations in convolutional neural networks using layer-by-layer training", Proc. SPIE 10341, Ninth International Conference on Machine Vision (ICMV 2016), 103410Q (17 March 2017); doi: 10.1117/12.2268722; https://doi.org/10.1117/12.2268722
PROCEEDINGS
5 PAGES


SHARE
Back to Top