14 May 2018 Randomness and isometries in echo state networks and compressed sensing
Author Affiliations +
Abstract
Although largely different concepts, echo state networks and compressed sensing models both rely on collections of random weights; as the reservoir dynamics for echo state networks, and the sensing coefficients in compressed sensing. Several methods for generating the random matrices and metrics to indicate desirable performance are well-studied in compressed sensing, but less so for echo state networks. This work explores any overlap in these compressed sensing methods and metrics for application to echo state networks. Several methods for generating the random reservoir weights are considered, and a new metric, inspired by the restricted isometry property for compressed sensing, is proposed for echo state networks. The methods and metrics are investigated theoretically and experimentally, with results suggesting that the same types of random matrices work well for both echo state network and compressed sensing scenarios, and that echo state network classification accuracy is improved when the proposed restricted isometry-like constants are close to 1.
© (2018) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Ashley Prater-Bennette, Ashley Prater-Bennette, "Randomness and isometries in echo state networks and compressed sensing", Proc. SPIE 10658, Compressive Sensing VII: From Diverse Modalities to Big Data Analytics, 106580J (14 May 2018); doi: 10.1117/12.2304029; https://doi.org/10.1117/12.2304029
PROCEEDINGS
10 PAGES


SHARE
Back to Top