Multi-atlas segmentation method has attracted increasing attention in the field of medical image segmentation. It segments the target image by combining warped atlas labels according to a label fusion strategy, usually based on the intensity information of the target and atlas images. However, it has been demonstrated that image intensity information itself is not discriminative enough for distinguishing different subcortical structures in brain magnetic resonance (MR) images. Recent advance in multi-atlas based segmentation has witnessed success of label fusion methods built on informative image features. The key component in these methods is the image feature extraction. Conventional image feature extraction methods, such as textural feature extraction, are built on manually designed image filters and their performance varies when applied to different segmentation problems. In this paper, we propose a random local binary pattern (RLBP) method to generate image features in a random fashion. Based on RLBP features, we use a local learning strategy to fuse labels in multi-atlas based segmentation. Our method has been validated for segmenting hippocampus from MR images. The experiment results have demonstrated that our method can achieve competitive segmentation performance as the state-of-the-art methods.