SAIC in support of the National Geospatial-Intelligence Agency (NGA) Synergistic Targeting Auto-Extraction and Registration (STAR) Program is conducting an evaluation of several automated registration applications developed by different vendors. A common problem when attempting to compare multiple automated registration packages is interpreting the results from the different applications in a consistent manner. Different vendors use different matching and adjustment methods as well as different output formats to store the results from automated registration. It is nearly impossible, due to the cost in terms of labor and time, to convert the results from different vendors into a common format or framework for evaluation. The approach taken by the STAR Program is to separate the automated registration process into three separate but equal components: automated data matching, data adjustment, and output format used to store the adjusted results. The results of different vendor's automated matching process will be fed into a single, common weighted least squares package for adjustment. The use of a common physics based adjustment process will allow the STAR Program Office to evaluate the results from several different automated registration applications in a consistent and fair manner. The metrics collected during the STAR Automated Registration Evaluation will include timing statistics, matching statistics, and geospatial accuracy statistics from comparisons to GPS survey sites. In this paper, we present the STAR automated registration evaluation architecture. Over the course of the next year the STAR Program Office will develop and then use this architecture to evaluate several different automated registration algorithms.