15 January 2013 Hyperspectral analysis using the correlation between image and reference
Author Affiliations +
J. of Biomedical Optics, 18(2), 020501 (2013). doi:10.1117/1.JBO.18.2.020501
We present the use of correlation analysis on spectral data in order to quantify the amount of a given spectrum present with respect to a reference spectrum. The method is shown to be useful in analyzing hyperspectral fluorescence images. It is unhindered by the linear relationship assumed in linear spectral unmixing, and in addition, it is shown to be robust with respect to noise.
Ellingsen, Reitan, Pedersen, and Lindgren: Hyperspectral analysis using the correlation between image and reference

The use of spectra in the identification and characterization of biological and chemical substances is constantly growing as the different measurement techniques are simplified and commercialized. The expansion from detecting a single spectrum from one point in the sample to measuring spectra for every pixel with a hyperspectral camera has opened the door to a lot of new applications. It has not yet reached its full potential, though it is used extensively in remote sensing, and it is now becoming part of commercial imaging setups for biomedical applications. In particular, the use of hyperspectral imaging in confocal microscopes (for example, the Zeiss META system) in microscopic analysis as classification in fluorescence in situ hybridization (FISH)1 and fluorescence microscopes has emerged. With this availability, the need for good methods for analyzing the large data sets (known as hyperspectral cubes) is apparent. Common ways of doing this analysis is by using principle component analysis (PCA)2 or linear spectral unmixing.3 In remote sensing, there has also been some usage of spectral mixture analysis4 and spectral angle mapping,5 as compared by Dennison et al.6

PCA works on the full hyperspectral cube without making assumptions about the sample, and it projects the spectral data into a new orthogonal basis, where the axes are computed with respect to the largest spread in the spectral data between pixels. In comparison, spectral unmixing works individually on each pixel and assumes that the resulting spectrum in a pixel is a linear combination of a set of reference spectra, and solves for the amount of each reference spectra using linear algebra. These techniques are straightforward and work well for samples with high signal-to-noise ratios and small effects from interfering background signals.

We use the data from individual pixels in the image, just as in the case of linear unmixing, but the analysis is based on the correlation coefficient7


where X and Y are random variables, σXY is the covariance between X and Y, and σX, σY is the standard deviation for X and Y, respectively. The correlation coefficient is scale-free, meaning that it is independent of the units of measure for X and Y. Its resulting value will be in the interval 1ρXY1, where 1 corresponds to (Y=X) and 1 to Y=X. In the case of hyperspectral data, the variables X and Y are the two spectra (one from the image and one from the reference) with N data points each, and the correlation coefficient (which will be called correlation from now on) is, then, given by
where X¯, Y¯ are the mean values of X and Y.

This method is robust with respect to noise, and it has been used for decades in remote sensing applications such as radar, where it can recover signals with signal-to-noise values of less than 1.8,9 Since the signal-to-noise ratio in hyperspectral data can be low, due to the total intensity being separated into numerous wavelength channels, the use of correlation is favorable on such signals.

As an application of the correlation analysis, a 379-day-old male APP/PS1 mouse was injected with the well-known luminescent conjugated oligothiophene (LCO) pFTAA,1011.12 which is known to bind to amyloid β plaques in the brain that are known to be related to the progression of Alzheimer’s disease.1011.12 Specifically, APP/PS1 mice were given two consecutive injections of pFTAA [or PBS for a reference autofluorescence (AF) spectrum] and were sacrificed 24 h after the second injection. The brain was snap-frozen, and 30 μm cryo sections were prepared. These sections were fixed in ethanol, rehydrated with PBS, and mounted with Dako fluorescence mounting medium (Dako Cytomation, Glostrup, Denmark).

In addition, a reference brain section from a 174-day-old female APP/PS1 mouse was injected with PBS buffer and used as reference for the AF. Both of these were imaged using a Carl Zeiss AG LSM 510 META system with a laser excitation of 800 nm. This excitation ensured 2-photon absorption at 400 nm in the sample, yielding visible fluorescence from the pFTAA as well as the AF. The oligothiophene pFTAA and other related polymer analogs, such as PTAA, are known to have an appreciable 2-photon absorption cross section at 800 nm.13 The fluorescence was then recorded into a spectrum for every pixel by the attached multichannel META detector. These pixels were then put together into a hyperspectral image. By acquiring such images for both the pFTAA and PBS sections, the correlation analysis could be done on the pFTAA brain section. The reference spectrum for the AF was found by imaging 10 plaques at an excitation wavelength of 800 nm, selecting the average spectrum of a circle with a diameter of 20 pixels in the central area of the plaques, and then averaging the 10 spectra into a reference spectrum. The pFTAA spectrum was defined from an average over a small region in the center of the plaque of the stained sample. An analysis was then done by calculating two different correlation coefficients between the measured spectra and the reference spectra of the stained sample. These correlation coefficient (from now on known as the correlation) images are shown in Fig. 1.

Fig. 1

Correlation analysis of the amyloid beta plaques in an APP/PS1 mouse brain section. (a) shows the intensity image with the plaques clearly visible, and (b) shows the references spectra for PBS (autofluorescence) and pFTAA. Correlation between the measured spectrum and (c) PBS (ρPBS) and (d) pFTAA (ρpFTAA) is also shown. The difference ρpFTAAρPBS is shown without thresholding in (e), and with a threshold of 6,000 counts in the intensity in (f).


The intensity of the image is shown in Fig. 1(a), and the two reference spectra for AF and the stain pFTAA are shown in Fig. 1(b). Figure. 1(c) and 1(d) displays the map of the correlation between the PBS (ρPBS) and pFTAA (ρpFTAA) of the stained sample data set, respectively. The last two figures, 1(e) and 1(f), show the difference ρpFTAAρPBS without thresholding on the intensity (e) and with a threshold of 6,000 counts (f).

As can be seen from the reference spectra, the two spectra are very similar, confirmed by calculating the correlation between them, which is 0.9715. Even though they are this similar and give a high correlation in the plaque, as seen in Fig. 1(c) and 1(d), there is a significant difference between them, shown in Fig. 1(e) and even more clearly in Fig. 1(f), with (ρpFTAA) being larger than ρPBS by approximately 0.04 for the whole plaque.

With the thresholding, we obtain a visually clearer mapping of the excess of the pFTTA signal, as shown in Fig. 1(f). As shown in this image, the method is good at distinguishing one reference spectrum from the background and/or AF, even though the method is well suited for analyzing more than one stain at a time, particularly when the stains have similar fluorescence spectra. In addition, it is not necessary to know more than one of the spectra present, as the correlation gives a statistical number of how similar the spectra are. This makes it possible to statistically compare different images, regardless of their difference in intensity due to factors such as different acquisition settings. Such applications will be tested and validated in forthcoming studies.

The example application of the correlation method on a brain section from an APP/PS1-mouse shows its ability to distinguish two or more similar spectra, including the AF. The method shows promising results for hyperspectral fluorescence and confocal images. It is especially good with noisy images due to the nature of the correlation. However, due to its form, it is best suited for use on spectra where only some of the contributing signals (such as reference spectra) are known.


This work was supported by the EU-FP7 Health Programme Project LUPAS. We acknowledge the members of the LUPAS consortium for discussions and samples used for testing this method; in particular, we acknowledge Susann Handrick and Sofie Nyström for sample preparation.



R. A. Schultzet al., “Hyperspectral imaging: a novel approach for microscopic analysis,” Cytometry 43(4), 239–247 (2001).CYTODQ0196-4763http://dx.doi.org/10.1002/(ISSN)1097-0320Google Scholar


I. T. Jolliffe, Principal Component Analysis, 2d Ed., Springer Series in Statistics, Springer-Verlag, New York (2002).Google Scholar


R. LansfordG. BearmanS. E. Fraser, “Resolution of multiple green fluorescent protein color variants and dyes using two-photon microscopy and imaging spectroscopy,” J. Biomed. Opt. 6(3), 311–318 (2001).JBOPFO1083-3668http://dx.doi.org/10.1117/1.1383780Google Scholar


C. M. PietersP. A. J. Englert, Eds., Remote Geochemical Analysis: Elemental and Mineralogical Composition, pp. 145–166, Cambridge University Press, Cambridge, UK (1993).Google Scholar


F. Kruseet al., “The spectral image processing system (SIPS)—Interactive visualization and analysis of imaging spectrometer data,” Remote Sens. Environ. 44(2–3), 145–163 (1993).RSEEA70034-4257http://dx.doi.org/10.1016/0034-4257(93)90013-NGoogle Scholar


P. E. DennisonK. Q. HalliganD. A. Roberts, “A comparison of error metrics and constraints for multiple endmember spectral mixture analysis and spectral angle mapper,” Remote Sens. Environ. 93(3), 359–367 (2004).RSEEA70034-4257http://dx.doi.org/10.1016/j.rse.2004.07.013Google Scholar


R. E. Walpoleet al., Probability and Statistics for Engineers and Scientists, pp. 95–102, Pearson Education International, Upper Saddle River, New Jersey (2002).Google Scholar


P. Tait, Introduction to Radar Target Recognition, IEEE Radar, Sonar, Navigation, and Avionics Series, pp. 77–80, The Institution of Engineering and Technology (2005).Google Scholar


J. A. Richards, Remote Sensing with Imaging Radar, Signals and Communication Technology, pp. 58–61, Springer, Berlin, Heidelberg (2009).Google Scholar


A. ÅslundK. P. R. NilssonP. Konradsson, “Fluorescent oligo and poly-thiophenes and their utilization for recording biological events of diverse origin—When organic chemistry meets biology,” J. Chem. Biol. 2(4), 161–175 (2009).CBOLE21074-5521http://dx.doi.org/10.1007/s12154-009-0024-8Google Scholar


T. KlingstedtK. P. R. Nilsson, “Luminescent conjugated poly- and oligo-thiophenes: optical ligands for spectral assignment of a plethora of protein aggregates,” Biochem. Soc. Trans. 40(4), 704–710 (2012).BCSTB50300-5127http://dx.doi.org/10.1042/BST20120009Google Scholar


K. P. R. NilssonM. LindgrenP. Hammarström, “A pentameric luminescent-conjugated oligothiophene for optical imaging of in vitro-formed amyloid fibrils and protein aggregates in tissue sections,” Methods Molec. Biol. 849, 425–434 (2012).MMBIED0097-0816http://dx.doi.org/10.1007/978-1-61779-551-0Google Scholar


F. Stabo-Eeget al., “Quantum efficiency and two-photon absorption cross-section of conjugated polyelectrolytes used for protein conformation measurements with applications on amyloid structures,” Chem. Phys. 336(2–3), 121–126 (2007).CMPHC20301-0104http://dx.doi.org/10.1016/j.chemphys.2007.06.020Google Scholar

Pal G. Ellingsen, Nina K. Reitan, Brede D. Pedersen, Mikael Lindgren, "Hyperspectral analysis using the correlation between image and reference," Journal of Biomedical Optics 18(2), 020501 (15 January 2013). http://dx.doi.org/10.1117/1.JBO.18.2.020501
Submission: Received ; Accepted


Atrial fibrillation


Hyperspectral imaging


Signal to noise ratio

Image analysis

Back to Top