Reconstruction of surface from contours in medical images is often used for modeling. Contouring is usually performed using a single cross-sectional orientation. A potentially more efficient and accurate approach is to use two or more sets of orthogonal contours. In this case, a computational algorithm is needed for reconstructing surface from sets of orthogonal contours. The orthogonal contours are transformed into mesh of 3D polygons. The contours are then resampled using spline interpolation. Finally all possible triangulations for each polygon are evaluated to obtain triangulation. An optimal is selected to reconstruct patch according to a minimum area criteria with constrain on the dihedron angle. All reconstructed patches are combined together to produce a reconstructed surface from orthogonal contours. This method was found to produce surfaces with a smooth and highly realistic appearance.