When EO/IR imagery is collected from an aerial platform, geo-registration (estimating the geo-detic coordinates of pixels within an image) is one of the key algorithms used for image and video exploitation. Unfortunately, the performance of geo-registration algorithms is difficult to evaluate due to variabilities in the quality and type of input data. In addition, previous evaluation approaches require large amounts of human intervention, leading to small amounts of quantitative data. We describe a new methodology and associated software used to evaluate and compare geo-registration algorithms in a more automated fashion. This methodology enables several thousand points to be tested as part of an evaluation. Results are presented on a study between several different geo-registration algorithms, demonstrating the utility of this new evaluation approach. Lessons learned on geo-registration performance are discussed.