Scarring can lead to significant cosmetic, psychosocial, and functional consequences in patients with hypertrophic scars from burn and trauma injuries. Therefore, quantitative assessment of scar is needed in clinical diagnosis and treatment. The Vancouver Scar Scale (VSS), the accepted clinical scar assessment tool, was introduced in the nineties and relies only on the physician subjective evaluation of skin pliability, height, vascularity, and pigmentation. To date, no entirely objective method has been available for scar assessment. So, there is a continued need for better techniques to monitor patients with scars. We introduce a new spectral imaging system combining out-of-plane Stokes polarimetry, Spatial Frequency Domain Imaging (SFDI), and three-dimensional (3D) reconstruction. The main idea behind this system is to estimate hemoglobin and melanin contents of scar using SFDI technique, roughness and directional anisotropy features with Stokes polarimetry, and height and general shape with 3D reconstruction. Our proposed tool has several advantages compared to current methodologies. First and foremost, it is non-contact and non-invasive and thus can be used at any stage in wound healing without causing harm to the patient. Secondarily, the height, pigmentation, and hemoglobin assessments are co-registered and are based on imaging and not point measurement, allowing for more meaningful interpretation of the data. Finally, the algorithms used in the data analysis are physics based which will be very beneficial in the standardization of the technique. A swine model has also been developed for hypertrophic scarring and an ongoing pre-clinical evaluation of the technique is being conducted.