Small size object detection in vast ocean plays an important role in rescues after accident or disaster. One of the promising approach is a hyperspectral imaging system (HIS). However, due to the limitation of HIS sensor’s resolution, interested target might occupy only several pixels or less in the image, it’s difficult to detect small object, moreover the sun glint of the sea surface make it even more difficult. In this paper, we propose an image analysis technique suitable for the computer aided detection of small objects on the sea surface, especially humans. We firstly separate objects from background by adapting a previously proposed image enhancement method and then apply a linear unmixing method to define the endmember’s spectrum. At last, we use spectral angle mapping method to classify presented objects and thus detect small size object. The proposed system provides the following results for supporting the detection of humans and other small objects on the sea surface; an image with spectral color enhancement, alerts of various objects, and the human detection results. This multilayered approach is expected to reduce the oversight, i.e., false negative error. Results of the proposed technique have been compared with existent methods, and our method has successfully enhance the hyperspectral image, and detect small object from the sea surface with high human detection rate, shows the ability to further detection of human in this study). The result are less influenced by the sun glint effects. This study helps recognizing small objects on the sea surface, and it leads to advances in the rescuing system using aircraft equipped HIS technology.