Calcium imaging is a widely used technique in neuroscience permitting the simultaneous monitoring of electro- physiological activity of hundreds of neurons at single cell resolution. Identification of neuronal activity requires rapid and reliable image analysis techniques, especially when neurons fire and move simultaneously over time. Traditionally, image segmentation is performed to extract individual neurons in the first frame of a calcium sequence. Thereafter, the mean intensity is calculated from the same region of interest in each frame to infer calcium signals. However, when cells move, deform and fire, this segmentation on its own generates artefacts and therefore biased neuronal activity. Therefore, there is a pressing need to develop a more efficient cell tracking technique. We hereby present a novel vision-based cell tracking scheme using a thin-plate spline deformable model. The thin-plate spline warping is based on control points detected using the Fast from Accelerated Segment Test descriptor and tracked using the Lucas-Kanade optical flow. Our method is able to track neurons in calcium time-series, even when there are large changes in intensity, such as during a firing event. The robustness and efficiency of the proposed approach is validated on real calcium time-lapse images of a neuronal population.