In this paper, we describe a new freehand ultrasound imaging system for reconstructing the left ventricle from 2D echocardiography slices. An important contribution of the proposed system is its ability to reconstruct from multiple standard views. The multi-view reconstruction procedure results in significant reduction in reconstruction error over single view reconstructions. The system uses object-based 3D volumetric registration, allowing for arbitrary rigid object movements in inter-view acquisition. Furthermore, a new segmentation procedure that combines level set methods with gradient vector flow(GVF) is used for automatically segmenting the 2D ultrasound images, in which low level of contrast, high level of speckle noise, and weak boundaries are common. The new segmentation approach is shown to be robust to these artifacts and is found to converge to the boundary from a wider range of initial conditions than competitive methods. The proposed system has been validated on a physical, 3D ultrasound calibration phantom and evaluated on one actual cardiac echocardiography data set. In the phantom experiment, two calibrated volumetric egg-shape objects were scanned from the top and side windows and reconstructed using the new method. The volume error was measured to be less than 4%. In a real heart data set experiment, qualitative results of 3D surface reconstruction from parasternal and apical views appear significantly improved over single view reconstructions. The estimated volumes from the 3D reconstructions were also found to be in agreement with the manual clinical measurements from 2D slices. Further extension of this work is to compare the quantitative results with more accuracy MRI data.