In this paper we present a methodology for validating a 3D Computer Aided Design (CAD) model's accuracy for radar data synthesis. CAD models have been used to generate computer simulated radar frequency (RF) data. One problem with existing CAD-based simulations is that there is no metric or tool to verify whether data produced from the CAD model can be classified correctly before and after modifications have been made. This paper presents a methodology to quantify the similarities and differences in data generated from CAD models before and after modifications and presents this information through confusion matrices and a visualization technique. Results for three experiments involving CAD model modifications are presented.