The peripheral nervous system plays an important role in motility, sensory, and autonomic functions of the human body. Preservation of peripheral nerves in surgery, namely nerve-sparing surgery, is now promising technique to avoid functional deficits of the limbs and organs following surgery as an aspect of the improvement of quality of life of patients. Detection of peripheral nerves including myelinated and unmyelinated nerves is required for the nerve-sparing surgery; however, conventional nerve identification scheme is sometimes difficult to identify peripheral nerves due to similarity of shape and color to non-nerve tissues or its limited application to only motor peripheral nerves. To overcome these issues, we proposed a label-free detection technique of peripheral nerves by means of Raman spectroscopy. We found several fingerprints of peripheral myelinated and unmyelinated nerves by employing a modified principal component analysis of typical spectra including myelinated nerve, unmyelinated nerve, and adjacent tissues. We finally realized the sensitivity of 94.2% and the selectivity of 92.0% for peripheral nerves including myelinated and unmyelinated nerves against adjacent tissues. Although further development of an intraoperative Raman spectroscopy system is required for clinical use, our proposed approach will serve as a unique and powerful tool for peripheral nerve detection for nerve-sparing surgery in the future.