The detection of shot boundaries in video sequences is an important task for generating indexed video databases. This paper provides a comprehensive quantitative comparison of the metrics, which have been applied to shot boundary detection. We will additionally consider several standardized statistical tests, which have not been applied to this problem, and three new metrics. A mathematical framework for quantitatively comparing metrics is supplied. Also included, are experimental results based on a video database containing 39,000 frames.